The package manager will only install the libraries from one of the libs/<abi>/ directory, depending on your device.
I'd recommend doing the following instead:
1/ Select only armeabi in your APP_ABI (or leave it undefined, this is the default)
2/ Build libBig.so and libSmall.so as armeabi libraries
3/ Build libSmallArmv7.so as an armeabi-v7a library. You can do that using by adding the following flags to its module definition:
LOCAL_CFLAGS += -march=armv7-a -mfloat-abi=softfp
LOCAL_LDLIBS += -Wl,--fix-cortex-a8
(these flags are described under docs/STANDALONE-TOOLCHAIN.html, in case you're curious).
This will ensure that your libSmallArmv7.so uses ARMv7-A CPU instructions. Note that the parameter-passing convention between armeabi and armeabi-v7a is compatible
(This is why -mfloat-abi=softfp is important, without it, your armeabi code would not be able to call your armeabi-v7a one if there are float or double parameters).
4/ Find a way in libBig.so to perform runtime CPU features probing (see docs/CPU-FEATURES.html) and call the functions in either libSmall.so or libSmallArmv7.so based on the result.
The three libraries will be installed on any armeabi or armeabi-v7a device, so please ensure that libSmallArmv7.so is not called by error on an armeabi one.
Voila, this is a bit of NDK voodoo, but it should work. The real hard part if doing 4/ properly.
This trick only works because both ABIs use the exact same toolchain. You can't do that to mix ARM and x86 binaries though :-)