S/Pdif is simply a consumer protocol generally not recommended for pro_audio high sampling rates. AES-EBU is the way to go for 96. But if you really must use 96, then the S/Pdif 3/4 has a better performance in terms of clocking stability.
You can't mix different sampling rates. One clock rate for the whole unit.