I handle lead solder similar to you, no soldering in the house, no food or drinks near the solder bench, and I always wash my hands immediately after soldering. It can be tedious at times, especially when troubleshooting / prototyping, but better safe than sorry.
I've never heard of D-Wipes, I'm going to have to see about getting some of those.
One thing folks tend to overlook is that lead-free solder has just as many (if not more) toxins than standard 60/40 lead solder.... it's just not lead.
When I used to work for the DOD there were SO many safety precautions it was ridiculous. Eye / ear protection for every day tasks. Super-Glue, Goo Gone, and regular isopropyl alcohol had to be stored in the Haz-Mat locker. We were even supposed to wear gloves when using wire cutters.
Ironically there were no standards in place for soldering... We had no fume extractors, no guidelines for handwashing, nothing.