Well, I replaced all the tantalum caps. Then I swapped out the transistors, ceramic caps, and the op-amps to no great effect, so I put the old components back. Looking at the schematic I found below, I decided to try some changes. I added a 100pF cap across R13. This smoothed out the noise...