The Fresno Fire Department shared video of crews rescuing the pooch just after 8 am Monday.
They found him stuck on the steep embankment at Elizabeth Street and Poplar Avenue.
With the help of a ladder and a catch pole, firefighters slowly pulled him to safety.
Fresno firefighters want to remind people that canals can be dangerous, even when water is not flowing through them.
If you live near a waterway, be sure to keep a close eye on children and pets.