A non-latching relay draws power continuously when set. A latching relay only needs a short pulse of power to get set or reset. It will then retain its current state without needing power.
When the device under latch loses power, sometimes you don't want it to return to its previous state when power is restored.
Also, non-latching consumes more power overall.
I think a major reason to pick a latching relay over non-latching is to save power when power comes at a cost (battery). If power draw is not a concern, non-latching relays are probably easier to deal with.