you can make spherical panorama in 3ds max or other program and call it panorama.jpg
So now you have your own 3d panorama based on Three.js
I will be very glad if somebody make plugin based on this idea. (I don't know how to do it myself)
you can test my TW5 and make panorama on image in attachment or find another image in internet.