CUDA driver version is insufficient for CUDA runtime version

[alecw...@gmail.com]

Hi there,

I have a problem with tensorflow and eager.  Below is the error information.

2017-12-31 00:59:12.033792: E tensorflow/core/common_runtime/direct_session.cc:168] Internal: cudaGetDevice() failed. Status: CUDA driver version is insufficient for CUDA runtime version

Traceback (most recent call last):

  File "/u/uname/.local/lib/python3.5/site-packages/tensorflow/python/eager/context.py", line 165, in _initialize_handle_and_devices

    self._context_handle = pywrap_tensorflow.TFE_NewContext(opts, status)

SystemError: <built-in function TFE_NewContext> returned NULL without setting an error

During handling of the above exception, another exception occurred:

Traceback (most recent call last):

  File "./experiments/folder/automatic.py", line 45, in <module>

    inputs, targets = tf.constant(normalized_x_train), tf.constant(normalized_y_train)

  File "/u/uname/.local/lib/python3.5/site-packages/tensorflow/python/framework/constant_op.py", line 184, in constant

    t = convert_to_eager_tensor(value, ctx, dtype)

  File "/u/uname/.local/lib/python3.5/site-packages/tensorflow/python/framework/constant_op.py", line 117, in convert_to_eager_tensor

    handle = ctx._handle  # pylint: disable=protected-access

  File "/u/uname/.local/lib/python3.5/site-packages/tensorflow/python/eager/context.py", line 193, in _handle

    self._initialize_handle_and_devices()

  File "/u/uname/.local/lib/python3.5/site-packages/tensorflow/python/eager/context.py", line 165, in _initialize_handle_and_devices

    self._context_handle = pywrap_tensorflow.TFE_NewContext(opts, status)

  File "/u/uname/.local/lib/python3.5/site-packages/tensorflow/python/framework/errors_impl.py", line 473, in __exit__

    c_api.TF_GetCode(self.status.status))

tensorflow.python.framework.errors_impl.InternalError: Failed to create session.

I have installed CUDNN-8.0 and CUDA-9.0. The cuda driver is :

 cat /proc/driver/nvidia/version                                                                          1 ↵

NVRM version: NVIDIA UNIX x86_64 Kernel Module  375.20  Tue Nov 15 16:49:10 PST 2016

GCC version:  gcc version 5.4.0 20160609 (Ubuntu 5.4.0-6ubuntu1~16.04.4)

I am confused.... why this error occurs.  Any one can help? Thanks!