Its simple. I merge grounds of all input left channel from all sources. Carry merged single left ground directly to buffer input. But switch selection only among live wires.did not understand this about let go grounds.
Any diagram ?
Same for right channel. Buffer merges both channel ground to power supply ground. So no mixing of ground current as power supply ground remains in middle.