It isn't exactly clear what your development setting is, but it sounds like you might have a local machine you are SSHing from and a server with a ChromiumOS VM you are trying to SSH to.
If so, there are lots of ways of getting this to work, but the more common one is to set up an SSH tunnel. The goal would be for the tunnel to make it look like the SSH port on the VM was available on your local machine so you could reach it over SSH.
If you haven't already, there is a lot of network related knowledge you might want to get a rough idea of before getting too deep into any of this to save yourself time. Some things to introduce yourself to are IP addresses and routing, sockets and ports, home networks and NAT (network address translation). Just knowing roughly what they are and what that means practically for whatever you are trying to do can help you get whatever you are trying to do to work.
For example the VM on the server is probably behind NAT so you cannot reach its IP address directly. This gives you a choice between forwarding the SSH port to some port on the server (this isn't a good idea because developer images use well known credentials), setting up an SSH tunnel to securely forward the port to your local machine, etc.