I don't see why not. For Apache, you would just place the relevant WSGIScriptAlias and WSGIPythonPath inside of your VirtualHost elements. You would need to be cautious about running a single WSGI process though, since the first site settings read will apply to all of your Django sites (which is probably not what you want), as explained at the end of the section in the Django docs here:
Haven't toyed enough with the others to know whether or not it is possible, but I'm sure all of the major servers have similar separation strategies for exactly this scenario.
A quick Google shows that Nginx/uWSGI can support multiple sites through the use of Emperor Mode and separate vassal configuration for each site, which sounds very similar to Apache/mod_wsgi daemon mode.
-James