Librosa's time-stretcher only operates on one channel at a time. It would be good to add stereo support, but in the meantime, you can do it manually by stretching each channel independently.
You might also consider using
pyrubberband, which should support stereo directly and will sound much better.