Sure. SSL sockets are tcp Sockets, save for the negotiation. If you don't want encryption, just don't call startServerEncription or the client version.
However, I would have to ask, why not just abstract it to be QTcpSocket*?
There is no overhead if you are encrypting.
In all my code, the only difference is if you are on a secure port, then you start the encryption. Also, you should have some way of reporting the SSL errors.