I would suggest that you set the levels so that the yellow leds light on louder signals. Not sure if this is the issue, but it is good practise.
You also need to make sure that the "source" switch is set correcly.
I'm assuming that you can see both signals on the 2 left hand meter columns. Make them yellow.
