The problem is that the expression pedal value might be changing even if you don't touch it. Even if you don't have your foot on the expression pedal it might be flickering back and forth between two values. This partly comes down to which expression pedal you're using and you might not run into this problem with another expression pedal.
