We've added your issue to a list of feature requests for a future update.
Are you using a lot of gain/distortion on your amp after the TimeFactor? If so that will add compression which will make the delay sound louder. Placing TimeFactor in an effects loop would fix this, but if that's not an option there is something you can try:
Set Delay B to Off (0 ms) and set just Delay A to a setting that you like. Then turn the Delay Mix knob almost all the way clockwise and the Mix knob almost all the way counter-clockwise. It will only be one delay, but you should be able to dial in a very low level of it. Let me know how it goes.