I haven't built it but I am familiar with the circuit. Using a 25kA pot might give slightly more fine control in that area, but probably not as much as you want. So, instead, I would suggest limiting the range of the control like you are suggesting.
Switch to a 10kA pot, and it should be wired...