Unfortunately, what you're trying to do is about the hardest thing you can ask it to do. Because the pitches are really low and not harmonically related by small ratios, the pitch shifter doesn't have a good place to join the sections. It might work better with more latency, but it would be so much latency that it would be a noticiable delay.
