A non-latching relay draws power continuously when set. A latching relay only needs a short pulse of power to get set or reset. It will then retain its current state without needing power.
When the device under latch loses power, sometimes you don't want it to return to its previous state when power is restored.
Also, non-latching consumes more power overall.