Ok, it didn't like that last mod. I noticed when I dropped regulated voltage I started getting distortion in the output. So I set the output voltlage back to the stock value of 11.6V with a 1k resistor. Now no more distortion, nice and clean sound again. I am back to running it on 18V input as well.
So looking for a different solution to make it a bit quieter, I added a 5k1 resistor in series with pin 3 of the pot. This helped get more usable range out of the pot and limited overall output.
Also upgraded the knob and added a decal.