Alright, TIL about input/output compensation networks.
Output was easy - a small value cap from pin 5 to out. Tried a few values while I had a sig gen/scope on, and about 47pf everything seemed to come good - about 3x the output and much less noise than without it.
For the input, most examples...