Hi,
Boolean values for json must be true/false in lower case (Trueis invalid). That's why you have errors in logs.
This said, your way to compare speed doesn't make sense. You cannot do it on a single frame.
The "problematic" device is one with a license which make sense as it takes more sense to init. Your timing the init only.
Another problem with your report is you provide no useful numbers, these are not full logs, it's just init part. Share full logs from benchmark app.
Use the benchmark app and read
-------- Original message --------
Date: 12/15/24 12:42 (GMT+01:00)
Subject: Problem with speed on similar devices
Good day!
I run it on 2 identical devices. It works fast on the first one, 2 times slower on the second one.
At the same time, the Init differs in the following lines (they are on the device, where it works normally, they are not on the problematic one):
*[COMPV INFO]: [CompVCpu] Enabling asm code
*[COMPV INFO]: [CompVCpu] Enabling intrinsic code
*[COMPV INFO]: [UltAlprSdkEnginePrivate]recogn_tf_num_threads: 6, acceleration backend:
*[COMPV INFO]: [UltAlprRecognizer] TensorRT not enabled, do not create the plugin for the OCR model.
*[COMPV INFO]: [UltOcrRecognizer] Your OCR module is neither GPU nor NPU optimized.
*[COMPV INFO]: [UltOcrTensorflowSessionOptions] Alloc session with gpu_memory_alloc_max_percent = 10%
*[COMPV INFO]: [UltOcrRecognizer] OCR module backend: Tensorflow
What's wrong? Something is disabled on problematic device?
Full log on normal device:
*[COMPV INFO]: [UltAlprSdkEngine]Call: init
*[COMPV INFO]: [UltAlprSdkEngine]jsonConfig: {"debug_level": "info", "debug_write_input_image_enabled": false, "debug_internal_data_path": ".", "num_threads": -1, "gpgpu_enabled": true, "max_latency": -1, "klass_vcr_gamma": 1.5, "detect_roi": [0, 0, 0, 0], "detect_minscore": 0.1, "car_noplate_detect_min_score": 0.8, "pyramidal_search_enabled": false, "pyramidal_search_sensitivity": 0.28, "pyramidal_search_minscore": 0.3, "pyramidal_search_min_image_size_inpixels": 800, "recogn_rectify_enabled": true, "recogn_minscore": 0.3, "recogn_score_type": "min", "assets_folder": "/r/assets", "openvino_enabled": "True", "openvino_device": "CPU"}
**[COMPV WARN]: function: "__UltAlprSdkJsonConfigParseBool()"
"/home/ultimate/ultimateALPR/SDK_dev/lib/source/ultimate_alpr_sdk_json_config.cxx"
line: "236"
message: [UltAlprSdkJsonConfig] openvino_enabled not a boolean
***[COMPV ERROR]: function: "parse()"
"/home/ultimate/ultimateALPR/SDK_dev/lib/source/ultimate_alpr_sdk_json_config.cxx"
line: "160"
message: Operation Failed (COMPV_ERROR_CODE_E_INVALID_PARAMETER) ->
*[COMPV INFO]: [UltAlprSdkEngine]**** Copyright (C) 2011-2024 Doubango Telecom <
https://www.doubango.org> ****
ultimateALPR-SDK <
https://github.com/DoubangoTelecom/ultimateALPR-SDK> version 3.13.2
*[COMPV INFO]: [CompVBase] Initializing [base] modules (v 1.0.0, nt -1)...
*[COMPV INFO]: [CompVBase] sizeof(compv_scalar_t)= #8
*[COMPV INFO]: [CompVBase] sizeof(float)= #4
*[COMPV INFO]: Initializing window registery
*[COMPV INFO]: [ImageDecoder] Initializing image decoder...
*[COMPV INFO]: [CompVCpu] H: 'Hardkernel ODROID-N2', S: '***', M: '', MN: ''
*[COMPV INFO]: [CompVBase] CPU features: [arm];[arm64];neon;neon_fma;vfpv4;
*[COMPV INFO]: [CompVBase] CPU cores: online=#6, conf=#6
*[COMPV INFO]: [CompVBase] CPU cache1: line size: #64B, size :#0KB
*[COMPV INFO]: [CompVBase] CPU Phys RAM size: #3712GB
*[COMPV INFO]: [CompVBase] CPU endianness: LITTLE
*[COMPV INFO]: /!\ Code in file '/home/ultimate/compv/base/compv_base.cxx' in function 'init' starting at line #195: Not optimized -> Your ARM OS is neither Android nor Raspberry Pi nor iOS nor NVIDIA Jetson. You may miss some optimizations. Let us know what's your OS.
*[COMPV INFO]: [CompVBase] Binary type: AArch64
*[COMPV INFO]: [CompVBase] Intrinsic enabled
*[COMPV INFO]: [CompVBase] Assembler enabled
*[COMPV INFO]: [CompVBase] Code built with option /arch:NEON
*[COMPV INFO]: [CompVBase] OS name: Generic Linux
*[COMPV INFO]: [CompVBase] Math Fast Trig.: true
*[COMPV INFO]: [CompVBase] Math Fixed Point: true
*[COMPV INFO]: [CompVMathExp] Init
*[COMPV INFO]: [CompVBase] Default alignment: #32
*[COMPV INFO]: [CompVBase] Best alignment: #32
*[COMPV INFO]: [CompVBase] Heap limit: #262144KB (#256MB)
*[COMPV INFO]: [CompVParallel] Initializing [parallel] module...
*[COMPV INFO]: [CompVAsyncTask11] run(coreId:requested=0,set=useless, threadId:0x7fa91d01f0, kThreadSetAffinity:false) - ENTER
*[COMPV INFO]: [CompVAsyncTask11] run(coreId:requested=1,set=useless, threadId:0x7fa59741f0, kThreadSetAffinity:false) - ENTER
*[COMPV INFO]: [CompVAsyncTask11] run(coreId:requested=2,set=useless, threadId:0x7fa51731f0, kThreadSetAffinity:false) - ENTER
*[COMPV INFO]: [CompVAsyncTask11] run(coreId:requested=4,set=useless, threadId:0x7fa41711f0, kThreadSetAffinity:false) - ENTER
*[COMPV INFO]: [CompVAsyncTask11] run(coreId:requested=3,set=useless, threadId:0x7fa49721f0, kThreadSetAffinity:false) - ENTER
*[COMPV INFO]: [CompVThreadDispatcher] Thread dispatcher created with #6 threads/#6 cores
*[COMPV INFO]: [CompVParallel] [Parallel] module initialized
*[COMPV INFO]: [CompVBase] [Base] modules initialized
*[COMPV INFO]: [CompVAsyncTask11] run(coreId:requested=5,set=useless, threadId:0x7fa39701f0, kThreadSetAffinity:false) - ENTER
*[COMPV INFO]: [CompVCore] Initializing [core] module (v 1.0.0)...
*[COMPV INFO]: [CompVFeature] Registering feature factory with id = 1 and name = 'FAST (Features from Accelerated Segment Test)'...
*[COMPV INFO]: [CompVFeature] Registering feature factory with id = 8 and name = 'ORB (Oriented FAST and Rotated BRIEF)'...
*[COMPV INFO]: [CompVFeature] Registering feature factory with id = 27 and name = 'Sobel edge detector'...
*[COMPV INFO]: [CompVFeature] Registering feature factory with id = 28 and name = 'Scharr edge detector'...
*[COMPV INFO]: [CompVFeature] Registering feature factory with id = 29 and name = 'Prewitt edge detector'...
*[COMPV INFO]: [CompVFeature] Registering feature factory with id = 20 and name = 'Canny edge detector'...
*[COMPV INFO]: [CompVFeature] Registering feature factory with id = 30 and name = 'Hough standard (STD)'...
*[COMPV INFO]: [CompVFeature] Registering feature factory with id = 31 and name = 'Kernel-based Hough transform (KHT)'...
*[COMPV INFO]: [CompVFeature] Registering feature factory with id = 41 and name = 'Standard Histogram of oriented gradients (S-HOG)'...
*[COMPV INFO]: [CompVMatcher] Registering matcher factory with id = 0 and name = 'Brute force matcher'...
*[COMPV INFO]: [CompVConnectedComponentLabeling] Registering connected component labeling factory with id = 1 and name = 'PLSL (Parallel Light Speed Labeling)'...
*[COMPV INFO]: [CompVConnectedComponentLabeling] Registering connected component labeling factory with id = 19 and name = 'LMSER (Linear Time Maximally Stable Extremal Regions)'...
*[COMPV INFO]: [CompVGL] Initializing [gl] module (v 1.0.0)...
*[COMPV INFO]: [CompVGL] GL module initialized
*[COMPV INFO]: [CompVGpu] Initializing [gpu] module (v 1.0.0)...
*[COMPV INFO]: [CompVSharedLib] Loading shared library from libcuda.so
*[COMPV INFO]: [CompVGpu] Failed to open CUDA lib
*[COMPV INFO]: [CompVCamera] Initializing [camera] module (v 1.0.0)...
*[COMPV INFO]: [CompVDrawing] Initializing [drawing] module (v 1.0.0)...
*[COMPV INFO]: [CompVDrawing] /!\ No jpeg decoder found
*[COMPV INFO]: [CompVDrawing] Drawing module initialized
*[COMPV INFO]: [UltAlprSdkEnginePrivate]Line in /r/assets/models.amlogic_npu/supported_hardware.txt -> [Khadas VIM3]
*[COMPV INFO]: [UltAlprSdkEnginePrivate]Your hardware (Hardkernel ODROID-N2) isn't registered in /r/assets/models.amlogic_npu/supported_hardware.txt. NPU acceleration will not be enabled.
*[COMPV INFO]: [CompVGpu] GPU enabled: true
*[COMPV INFO]: /!\ Code in file '/home/ultimate/ultimateBase/lib/source/ultimate_base_engine.cxx' in function 'init' starting at line #75: Not optimized for GPU -> GPGPU computing not enabled or deactivated
*[COMPV INFO]: [UltBaseOpenCL] Trying to load [libOpenCL.so]
*[COMPV INFO]: [CompVSharedLib] Loading shared library from libOpenCL.so
*[COMPV INFO]: [UltBaseOpenCL] Failed to load [libOpenCL.so]
*[COMPV INFO]: [UltOcrEngine] Tensorflow version: 1.12.3
*[COMPV INFO]: [UltAlprSdkEnginePrivate]**** Copyright (C) 2011-2024 Doubango Telecom <
https://www.doubango.org> ****
You're using an unlicensed version of ultimateALPR-SDK <
https://github.com/DoubangoTelecom/ultimateALPR-SDK>
without the rights to include the SDK in any form of commercial product.
*[COMPV INFO]: [UltAlprSdkEnginePrivate]IC took 0 millis
*[COMPV INFO]: [CompVCpu] Enabling asm code
*[COMPV INFO]: [CompVCpu] Enabling intrinsic code
*[COMPV INFO]: [UltAlprSdkEnginePrivate]recogn_tf_num_threads: 6, acceleration backend:
*[COMPV INFO]: [UltAlprRecognizer] TensorRT not enabled, do not create the plugin for the OCR model.
*[COMPV INFO]: [UltOcrRecognizer] Your OCR module is neither GPU nor NPU optimized.
*[COMPV INFO]: [UltOcrTensorflowSessionOptions] Alloc session with gpu_memory_alloc_max_percent = 10%
*[COMPV INFO]: [UltOcrRecognizer] OCR module backend: Tensorflow
*[COMPV INFO]: /!\ Code in file '/home/ultimate/compv/base/compv_mem.cxx' in function 'CompVMemCopy_C' starting at line #985: Not optimized -> No SIMD implementation found. On ARM consider
http://infocenter.arm.com/help/index.jsp?topic=/com.arm.doc.faqs/ka13544.html*[COMPV INFO]: /!\ Code in file '/home/ultimate/compv/base/compv_mem.cxx' in function 'CompVMemCopy_C' starting at line #985: Not optimized -> No SIMD implementation found. On ARM consider
http://infocenter.arm.com/help/index.jsp?topic=/com.arm.doc.faqs/ka13544.html[PythonRecognizer] Init: OK -> {}
Full log on problematic device:
*[COMPV INFO]: [UltAlprSdkEngine]Call: init
*[COMPV INFO]: [UltAlprSdkEngine]jsonConfig: {"license_token_data": "ANI6+wW8BUVDUFFVdzBBR1VQRkMuBApERW4nS1FTRkg/KTEAGTwQeEtZREJSVEdXMU1wBm5OJk1eXFk3fhRuVW9YW1xrMAUuNCorBS4JX0t2QEtFVzlyUEF1KWJORUtFKAQnBBhFbGtRQldXdCIDBi5mIVxlAWlkYVNpYUZUTglfP29WS0AQIF8rBxdcanhQWXUwJTsvExsBWF1sfTZ9bncxSEJFcUgUDVlrWjU2VyEpAihReWoyQiEhJj8BXwJjfG0O", "debug_level": "error", "debug_write_input_image_enabled": false, "debug_internal_data_path": ".", "num_threads": -1, "gpgpu_enabled": "True", "max_latency": -1, "detect_roi": [0, 0, 0, 0], "detect_minscore": 0.1, "car_noplate_detect_min_score": 0.5, "pyramidal_search_enabled": false, "pyramidal_search_sensitivity": 0.28, "pyramidal_search_minscore": 0.3, "pyramidal_search_min_image_size_inpixels": 800, "recogn_rectify_enabled": true, "recogn_minscore": 0.3, "recogn_score_type": "min", "assets_folder": "/r/assets", "openvino_enabled": "True", "openvino_device": "CPU"}
**[COMPV WARN]: function: "__UltAlprSdkJsonConfigParseBool()"
"/home/ultimate/ultimateALPR/SDK_dev/lib/source/ultimate_alpr_sdk_json_config.cxx"
line: "236"
message: [UltAlprSdkJsonConfig] gpgpu_enabled not a boolean
***[COMPV ERROR]: function: "parse()"
"/home/ultimate/ultimateALPR/SDK_dev/lib/source/ultimate_alpr_sdk_json_config.cxx"
line: "148"
message: Operation Failed (COMPV_ERROR_CODE_E_INVALID_PARAMETER) ->
**[COMPV WARN]: function: "__UltAlprSdkJsonConfigParseBool()"
"/home/ultimate/ultimateALPR/SDK_dev/lib/source/ultimate_alpr_sdk_json_config.cxx"
line: "236"
message: [UltAlprSdkJsonConfig] openvino_enabled not a boolean
***[COMPV ERROR]: function: "parse()"
"/home/ultimate/ultimateALPR/SDK_dev/lib/source/ultimate_alpr_sdk_json_config.cxx"
line: "160"
message: Operation Failed (COMPV_ERROR_CODE_E_INVALID_PARAMETER) ->
*[COMPV INFO]: [UltAlprSdkEngine]**** Copyright (C) 2011-2024 Doubango Telecom <
https://www.doubango.org> ****
ultimateALPR-SDK <
https://github.com/DoubangoTelecom/ultimateALPR-SDK> version 3.13.2
*[COMPV INFO]: [CompVBase] Initializing [base] modules (v 1.0.0, nt -1)...
*[COMPV INFO]: [CompVBase] sizeof(compv_scalar_t)= #8
*[COMPV INFO]: [CompVBase] sizeof(float)= #4
*[COMPV INFO]: Initializing window registery
*[COMPV INFO]: [ImageDecoder] Initializing image decoder...
*[COMPV INFO]: [CompVCpu] H: 'Hardkernel ODROID-N2', S: '***', M: '', MN: ''
*[COMPV INFO]: [CompVBase] CPU features: [arm];[arm64];neon;neon_fma;vfpv4;
*[COMPV INFO]: [CompVBase] CPU cores: online=#6, conf=#6
*[COMPV INFO]: [CompVBase] CPU cache1: line size: #64B, size :#0KB
*[COMPV INFO]: [CompVBase] CPU Phys RAM size: #3712GB
*[COMPV INFO]: [CompVBase] CPU endianness: LITTLE
*[COMPV INFO]: /!\ Code in file '/home/ultimate/compv/base/compv_base.cxx' in function 'init' starting at line #195: Not optimized -> Your ARM OS is neither Android nor Raspberry Pi nor iOS nor NVIDIA Jetson. You may miss some optimizations. Let us know what's your OS.
*[COMPV INFO]: [CompVBase] Binary type: AArch64
*[COMPV INFO]: [CompVBase] Intrinsic enabled
*[COMPV INFO]: [CompVBase] Assembler enabled
*[COMPV INFO]: [CompVBase] Code built with option /arch:NEON
*[COMPV INFO]: [CompVBase] OS name: Generic Linux
*[COMPV INFO]: [CompVBase] Math Fast Trig.: true
*[COMPV INFO]: [CompVBase] Math Fixed Point: true
*[COMPV INFO]: [CompVMathExp] Init
*[COMPV INFO]: [CompVBase] Default alignment: #32
*[COMPV INFO]: [CompVBase] Best alignment: #32
*[COMPV INFO]: [CompVBase] Heap limit: #262144KB (#256MB)
*[COMPV INFO]: [CompVParallel] Initializing [parallel] module...
*[COMPV INFO]: [CompVThreadDispatcher] Thread dispatcher created with #6 threads/#6 cores
*[COMPV INFO]: [CompVParallel] [Parallel] module initialized
*[COMPV INFO]: [CompVBase] [Base] modules initialized
*[COMPV INFO]: [CompVCore] Initializing [core] module (v 1.0.0)...
*[COMPV INFO]: [CompVFeature] Registering feature factory with id = 1 and name = 'FAST (Features from Accelerated Segment Test)'...
*[COMPV INFO]: [CompVFeature] Registering feature factory with id = 8 and name = 'ORB (Oriented FAST and Rotated BRIEF)'...
*[COMPV INFO]: [CompVFeature] Registering feature factory with id = 27 and name = 'Sobel edge detector'...
*[COMPV INFO]: [CompVFeature] Registering feature factory with id = 28 and name = 'Scharr edge detector'...
*[COMPV INFO]: [CompVFeature] Registering feature factory with id = 29 and name = 'Prewitt edge detector'...
*[COMPV INFO]: [CompVFeature] Registering feature factory with id = 20 and name = 'Canny edge detector'...
*[COMPV INFO]: [CompVFeature] Registering feature factory with id = 30 and name = 'Hough standard (STD)'...
*[COMPV INFO]: [CompVFeature] Registering feature factory with id = 31 and name = 'Kernel-based Hough transform (KHT)'...
*[COMPV INFO]: [CompVFeature] Registering feature factory with id = 41 and name = 'Standard Histogram of oriented gradients (S-HOG)'...
*[COMPV INFO]: [CompVMatcher] Registering matcher factory with id = 0 and name = 'Brute force matcher'...
*[COMPV INFO]: [CompVConnectedComponentLabeling] Registering connected component labeling factory with id = 1 and name = 'PLSL (Parallel Light Speed Labeling)'...
*[COMPV INFO]: [CompVConnectedComponentLabeling] Registering connected component labeling factory with id = 19 and name = 'LMSER (Linear Time Maximally Stable Extremal Regions)'...
*[COMPV INFO]: [CompVGL] Initializing [gl] module (v 1.0.0)...
*[COMPV INFO]: [CompVGL] GL module initialized
*[COMPV INFO]: [CompVGpu] Initializing [gpu] module (v 1.0.0)...
*[COMPV INFO]: [CompVSharedLib] Loading shared library from libcuda.so
*[COMPV INFO]: [CompVGpu] Failed to open CUDA lib
*[COMPV INFO]: [CompVCamera] Initializing [camera] module (v 1.0.0)...
*[COMPV INFO]: [CompVDrawing] Initializing [drawing] module (v 1.0.0)...
*[COMPV INFO]: [CompVDrawing] /!\ No jpeg decoder found
*[COMPV INFO]: [CompVDrawing] Drawing module initialized
*[COMPV INFO]: [CompVAsyncTask11] run(coreId:requested=5,set=useless, threadId:0x7f941e11f0, kThreadSetAffinity:false) - ENTER
*[COMPV INFO]: [CompVAsyncTask11] run(coreId:requested=3,set=useless, threadId:0x7f951e31f0, kThreadSetAffinity:false) - ENTER
*[COMPV INFO]: [CompVAsyncTask11] run(coreId:requested=0,set=useless, threadId:0x7f995d61f0, kThreadSetAffinity:false) - ENTER
*[COMPV INFO]: [CompVAsyncTask11] run(coreId:requested=1,set=useless, threadId:0x7f961e51f0, kThreadSetAffinity:false) - ENTER
*[COMPV INFO]: [CompVAsyncTask11] run(coreId:requested=4,set=useless, threadId:0x7f949e21f0, kThreadSetAffinity:false) - ENTER
*[COMPV INFO]: [CompVAsyncTask11] run(coreId:requested=2,set=useless, threadId:0x7f959e41f0, kThreadSetAffinity:false) - ENTER
*[COMPV INFO]: [UltAlprSdkEnginePrivate]Line in /r/assets/models.amlogic_npu/supported_hardware.txt -> [Khadas VIM3]
*[COMPV INFO]: [UltAlprSdkEnginePrivate]Your hardware (Hardkernel ODROID-N2) isn't registered in /r/assets/models.amlogic_npu/supported_hardware.txt. NPU acceleration will not be enabled.
*[COMPV INFO]: [CompVGpu] GPU enabled: true
*[COMPV INFO]: /!\ Code in file '/home/ultimate/ultimateBase/lib/source/ultimate_base_engine.cxx' in function 'init' starting at line #75: Not optimized for GPU -> GPGPU computing not enabled or deactivated
*[COMPV INFO]: [UltBaseOpenCL] Trying to load [libOpenCL.so]
*[COMPV INFO]: [CompVSharedLib] Loading shared library from libOpenCL.so
*[COMPV INFO]: [UltBaseOpenCL] Failed to load [libOpenCL.so]
*[COMPV INFO]: [UltOcrEngine] Tensorflow version: 1.12.3
*[COMPV INFO]: [UltBaseEngine]UltBaseEngineReadSystemFile: fgets[18446744073709551615] returned valid string
*[COMPV INFO]: [UltAlprSdkEnginePrivate]IC took 0 millis
[PythonRecognizer] Init: OK -> {}
--
You received this message because you are subscribed to the Google Groups "doubango-ai" group.
To unsubscribe from this group and stop receiving emails from it, send an email to
doubango-ai...@googlegroups.com.
To view this discussion visit
https://groups.google.com/d/msgid/doubango-ai/4379a810-66b1-4529-be7c-aac7411c1d6cn%40googlegroups.com.