Pitchshifting algorithm uses 2 interpolated delay lines, so it introduces delay by design. You can change its amount here: I would expect shorter delay buffer sizes to add more artifacts, but current value is surprisingly big - I think it would give you 340ms latency. That PitchShifter...
forum.electro-smith.com