Thanks for the quick reply, Robert.
I've now put in a B50K dual gang pot, and wired the switch like above. The circuit passes audio when off, and when on, the dual gang pot behaves in the reverse of how it should: turning it down all the way increases volume/gain, and turning it up decreases...