Yes, you did. Each tx-rx pair has its own channel realization, so even though they are close geographically, channel can be absolutely different.
That is a limitation on the 3GPP channel model. In the future you'll be able to use 5G-LENA with a ray-traced channel model, where that difference will go away.
Right now, what you could try is setting the same the exact same stream number to each individual UE.