Try increasing the timeout for qrexec.
The typical wait time isn't very long, and if your PC is slow or doesn't have much power available for booting the guest, then it's possible that inside the guest things have not fully started when dom0 tries to communicate to the guest.
(at least, that's what I found)
I think there's no technical reason but nobody has added this yet.