> the chroot are using soft-float architecture.
> Different from hard-float used outside of chroot.
My understanding is hard-float libraries can be used in a chroot environment.
Hardware FPU is available on Raspberry pi.
Soft-float by default will use hardware FPU, if it is available, and these libraries will also work on Raspberry Pi.
VMX-pi HAL library is used from multiple languages uses other pre-compiled libraries - all designed to run correctly on raspberry Pi.  What you are asking for is a very large change.  More importantly, I do not clearly understand why it should be required, or what other workarounds might exist to solve the issue you have.
The last error message reported was:  "W:  Failed to change to directory /usr/local/lib/vmxpi':  No such file or directory".  Did you resolve this issue already?
If you did resolve this error already, what new error messages are you getting now?