Yes, you can do that. There are different bypass modes for the TimeFactor. The bypass mode DSP+FX will do what you described. It's in the TimeFactor manual on pg 19.
https://s3.amazonaws.com/com.eventide.downloads/Product+Manuals/TimeFactorManual.pdf
