Is Flex delegate compatible with CUDA?

46 views
Skip to first unread message

Iosif Hamlatzis

unread,
Jan 31, 2022, 8:49:16 AMJan 31
to TensorFlow Lite
I have created a model with SELECT OPS but if I have CUDA enabled it crashes both under Python and C++, but works fine if CUDA isn't enabled

When CUDA is enabled (and only then) I get an error message 

"op 'ReadVariableOp' output%d tensor#%d shape mismatch for [144] != []" from file "./tensorflow/lite/delegates/flex/kernel.cc" at line 590 and then it goes to file "./tensorflow/lite/delegates/flex/delegate.cc" in method "CopyFromBufferHandle" in line 160
and crashes "memcpy(output->data.raw, t_data.data(), t_data.size());"

Any idea?

Terry (Woncheol) Heo

unread,
Mar 2, 2022, 1:49:43 PMMar 2
to TensorFlow Lite, i.ham...@gmail.com
Since the main target of TFLite is mobile and IoT devices, CUDA is not our major target environment.
So the using CUDA for SELECT OPS is not verified.

But if you're interested in GPU acceleration of mobile, you could use OpenCL for TFLite kernels.
Reply all
Reply to author
Forward
0 new messages