You should be shunting the input to ground, not the output.
You're probably hearing that big 10uF charge/discharge with each switch cycle.
EDIT: Nevermind, I see now that the bypass switching isn't actually part of your circuit and you've just drawn the 3PDT switching (I think?)...