To be able to write to (aka use) the port, you have to add your user permissions to the port using "sudo usermod -a -G dialout $USER" from a terminal window. That part will not matter if you are using Lite or Desktop versions.
As far as how the system performs, running the Lite version (no desktop) will typically out-perform the Desktop version.