Hi Shawn,
If you want to use something else than openCV, you might want to try FastCV (and maybe Vuforia too) from Qualcomm. These have been optimized for phones and tablets.
You can also use the NDK with openCV, or actually use openGL to perform the computation on the GPU.