So, I was able to fix this issue by ensuring a few things:
1. I use chef for deployment so I made sure zookeeper was never started by chef, only managed by Exhibitor
2. I create a zoo.cfg with chef, but I DO NOT add server listings to the file. This will murk with consistency. (This probably shouldn't be done at all)
3. When you run Exhibitor, run it as root, or make sure all directories related to zookeeper are given open permissions to the profile running exhibitor
- In my case I run it as root, meh, but
Doing these things solved it for me! Number 3 was crucial