You still can make your solution look more elegant.
First, 'vec' is unnecessary -- you can provide sequence as a final result.
Then, since Clojure string is Java string, instead of (. String valueOf %) you can just write (str %).
Another way is to even avoid Java interop. Since (int \0) equals 48,
you can use 'int' conversion as in your original solution and then subtract 48.