totally with you. we did some modifications in neo4j to fit for cloud-deployment.
it would be choosing of the latest stable release(1.6) or the current milestone. if you select milestone you will be auto-upgraded by default.
at the heroku-addon page you can disable the auto-update then.
cheers, thomas