The USB/LSB reversal happens when one of I & Q is inverted. If you look "along" the time axis with I&Q as horizontal and vertical, positive frequencies spiral clockwise and negative frequencies spiral anti-clockwise - or vice versa depending on phase inversion.
The zero bin from the FFT contains the DC spike. The fundamental is bin[1] and the negative fundamental is the last bin - these correspond to a single cycle at the length of the FFT.
If one of I or Q is disabled (set to zero) then the negative frequencies are a mirror of the positive ones. Likewise if the gain on I is different from the gain on Q; you get a partial image in the negative half of frequencies that are positive, and vice versa. This is a serious factor to consider in the design of an I/Q demodulator.