Hello,
let me step in here for my colleague to give you details about our issue.
Yes, we have tried it on JetPack 4.6.2, and the main issue is that Nvidia went from TensorRT 7 (7.1.3) in 4.4.1 to TensorRT 8 (8.2.1) in 4.6.2. As you already said, the SKD will run on other versions of Jetpack when at least the major TensorRT and CUDA match. Just for reference, we also tried running the 5.1.0 implementation without success.
Some more details:
On Jetpack 4.6.2, the compilation will fail with the message
message: [CompVSharedLib] Failed to load library with path=/home/nvidia/axess_eval/ultimateALPR-SDK-master/binaries/jetson/aarch64/libultimatePluginTensorRT.so, Error: libnvinfer.so.7: cannot open shared object file: No such file or directory
indicating it cannot find the libraries for TensorRT 7. We also tried adding symlinks, but this just led to a crash in the Nvidia libraries - which is expected due to the different major releases. When trying the 5.1.0 binaries, which are built against TensorRT 8 (but a different minor version), we get a mismatch in the CUDA version (version update from 10.2 to 11.4 - again a different major release) as the following error shows
message: [CompVSharedLib] Failed to load library with path=/home/nvidia/axess_eval/ultimateALPR-SDK-master/binaries/jetson/aarch64/libultimatePluginTensorRT.so, Error: libcudart.so.11.0: cannot open shared object file: No such file or directory
Finally, some additional words on JetPack 4.6.2:
JetPack 4.6.2 is the latest and final release for the TX2 family. In addition, Nvidia made a significant step by moving from TensorRT 7 to TensorRT 8 regardi
Below the full output
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
sudo chmod +x ./prepare.sh && sudo ./prepare.sh
Your Jetpack version is Version: 4.6-b199
Version: 4.6-b197
Preparing for Jetpack 4.4.1...
*[ULTALPR_SDK INFO]:
** This application is used to generate optimized NVIDIA TensorRT models **
*[COMPV INFO]: [UltAlprSdkEngine]Call: optimizeTRT
*[COMPV INFO]: [CompVBase] Initializing [base] modules (v 1.0.0, nt 1)...
*[COMPV INFO]: [CompVBase] sizeof(compv_scalar_t)= #8
*[COMPV INFO]: [CompVBase] sizeof(float)= #4
*[COMPV INFO]: Initializing window registery
*[COMPV INFO]: [ImageDecoder] Initializing image decoder...
*[COMPV INFO]: [CompVCpu] H: '', S: '', M: '', MN: 'ARMv8 Processor rev 3 (v8l)'
*[COMPV INFO]: [CompVBase] CPU features: [arm];[arm64];neon;neon_fma;vfpv4;
*[COMPV INFO]: [CompVBase] CPU cores: online=#6, conf=#6
*[COMPV INFO]: [CompVBase] CPU cache1: line size: #64B, size :#0KB
*[COMPV INFO]: [CompVBase] CPU Phys RAM size: #3831GB
*[COMPV INFO]: [CompVBase] CPU endianness: LITTLE
*[COMPV INFO]: [CompVBase] Binary type: AArch64
*[COMPV INFO]: [CompVBase] Intrinsic enabled
*[COMPV INFO]: [CompVBase] Assembler enabled
*[COMPV INFO]: [CompVBase] Code built with option /arch:NEON
*[COMPV INFO]: [CompVBase] OS name: Jetson_TFTRT
*[COMPV INFO]: [CompVBase] Math Fast Trig.: true
*[COMPV INFO]: [CompVBase] Math Fixed Point: true
*[COMPV INFO]: [CompVMathExp] Init
*[COMPV INFO]: [CompVBase] Default alignment: #32
*[COMPV INFO]: [CompVBase] Best alignment: #32
*[COMPV INFO]: [CompVBase] Heap limit: #262144KB (#256MB)
*[COMPV INFO]: [CompVParallel] Initializing [parallel] module...
*[COMPV INFO]: [CompVParallel] [Parallel] module initialized
*[COMPV INFO]: [CompVBase] [Base] modules initialized
*[COMPV INFO]: [UltAlprSdkTRT] Optimizing models in [../../../assets/models.tensorrt/] folder...
*[COMPV INFO]: [FileUtils] Loading files in ../../../assets/models.tensorrt/ ...
*[COMPV INFO]: [CompVSharedLib] Loading sharded library from /home/nvidia/axess_eval/ultimateALPR-SDK-master/binaries/jetson/aarch64/libultimatePluginTensorRT.so
***[COMPV ERROR]: function: "open()"
file: "/home/ultimate/compv/base/compv_sharedlib.cxx"
line: "71"
message: [CompVSharedLib] Failed to load library with path=/home/nvidia/axess_eval/ultimateALPR-SDK-master/binaries/jetson/aarch64/libultimatePluginTensorRT.so, Error: libnvinfer.so.7: cannot open shared object file: No such file or directory
***[COMPV ERROR]: function: "open()"
file: "/home/ultimate/compv/base/compv_sharedlib.cxx"
line: "73"
message: Operation Failed (COMPV_ERROR_CODE_E_NOT_FOUND) ->
***[COMPV ERROR]: function: "newObj()"
file: "/home/ultimate/compv/base/compv_sharedlib.cxx"
line: "119"
message: Operation Failed (COMPV_ERROR_CODE_E_NOT_FOUND) ->
***[COMPV ERROR]: function: "optimize()"
file: "/home/ultimate/ultimateALPR/SDK_dev/lib/source/ultimate_alpr_sdk_trt.cxx"
line: "78"
message: Operation Failed (COMPV_ERROR_CODE_E_NOT_FOUND) ->
***[COMPV ERROR]: function: "optimizeTRT()"
file: "/home/ultimate/ultimateALPR/SDK_dev/lib/source/ultimate_alpr_sdk_private_engine.cxx"
line: "733"
message: Operation Failed (COMPV_ERROR_CODE_E_NOT_FOUND) ->
***[COMPV ERROR]: function: "UltimateBaseDebugPrint()"
file: "/home/ultimate/ultimateALPR/SDK_dev/lib/../../../ultimateBase/lib/include/ultimate_base_debug.h"
line: "51"
message: [[Check Code]]Operation Failed (COMPV_ERROR_CODE_E_NOT_FOUND) -> OptimizeTRT failed
***[ULTALPR_SDK ERROR]: function: "main()"
file: "/home/ultimate/ultimateALPR/SDK_dist/samples/c++/trt_optimizer/trt_optimizer.cxx"
line: "61"
message:
*** Failed: code -> 20003, phrase -> OptimizeTRT failed ***
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Martin