You got the right mindset, sir!
My thought: Why not add (or copy and insert) a dry blend board alongside a muff 2, with a trimpot instead of a pot, and switch that in and out? This way you can tweak the amount at any time.
Like: https://jmkpcbs.com/product/panner/
From a lesson learned here...