Given that you can install and run Debian or ubuntu at the same time as Android, not too hard.
Use the XSDL app on play for the X11 server, "env DISPLAY=localhost:0 lxsession &" to launch.*lxde for example. *(assumes it is installed)
Use debian kit to install Debian or ubuntu--- Debian Wheezy worked best for me so far.
(using a 64bit kernel running on android-x86 4.3test build)