The simple answer is yes, UMULL will be available. There is some detail though:
The NDK supports ARMv5TE or ARMv7 - in the form of armeabi and armeabi-v7a, both of these are
capable of UMULL instructions.
For armeabi binaries you will need to be in ARM state (the instruction is not supported by Thumb), for armeabi-v7 either
ARM or Thumb2 provide the instruction.