You will not get any true latency-free operations where a computer is involved.
If you are handy with a soldering iron, you could make up an XLR to 1/4" adaptor and drive the headphones from the back of the unit. This will work best with high impedance phones, but will drive regular phones at a modest volume. The output will distort if you push it too far.
