rocketsled: error on running 'python setup.py test'

Nitin Kumar

unread,

Aug 30, 2019, 5:32:43 PM8/30/19

to fireworkflows

Hi,

I am getting an error (attached below) after installing and running the "python setup.py test". The tests seems to have passed but some error shows up after the 'OK'.

I have Fireworks 1.9.0 and Rocketsled 2019.6.5

Thanks.

Nitin

====================================================================================================================

ok

test_Dtypes (rocketsled.tests.test_utils.TestUtilities) ... ok

test_check_dims (rocketsled.tests.test_utils.TestUtilities) ... ok

test_convert_native (rocketsled.tests.test_utils.TestUtilities) ... ok

test_convert_value_to_native (rocketsled.tests.test_utils.TestUtilities) ... ok

test_deserialize (rocketsled.tests.test_utils.TestUtilities) ... ok

test_get_default_opttask_kwargs (rocketsled.tests.test_utils.TestUtilities) ... ok

test_get_len (rocketsled.tests.test_utils.TestUtilities) ... ok

test_is_discrete (rocketsled.tests.test_utils.TestUtilities) ... ok

test_latex_float (rocketsled.tests.test_utils.TestUtilities) ... ok

test_pareto (rocketsled.tests.test_utils.TestUtilities) ... ok

test_random_guess (rocketsled.tests.test_utils.TestUtilities) ... ok

test_serialize (rocketsled.tests.test_utils.TestUtilities) ... ok

test_split_xz (rocketsled.tests.test_utils.TestUtilities) ... ok

test_tolerance_check (rocketsled.tests.test_utils.TestUtilities) ... ok

----------------------------------------------------------------------

Ran 24 tests in 31.021s

OK

Error in atexit._run_exitfuncs:

Traceback (most recent call last):

File "<frozen importlib._bootstrap>", line 983, in _find_and_load

File "<frozen importlib._bootstrap>", line 953, in _find_and_load_unlocked

File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed

File "/home/nkumar/.conda-envs/Adapt/lib/python3.7/site-packages/sklearn/__init__.py", line 64, in <module>

from .base import clone

File "/home/nkumar/.conda-envs/Adapt/lib/python3.7/site-packages/sklearn/base.py", line 11, in <module>

import numpy as np

File "/home/nkumar/.conda-envs/Adapt/lib/python3.7/site-packages/numpy/__init__.py", line 142, in <module>

from . import core

File "/home/nkumar/.conda-envs/Adapt/lib/python3.7/site-packages/numpy/core/__init__.py", line 40, in <module>

from . import multiarray

File "/home/nkumar/.conda-envs/Adapt/lib/python3.7/site-packages/numpy/core/multiarray.py", line 12, in <module>

from . import overrides

File "/home/nkumar/.conda-envs/Adapt/lib/python3.7/site-packages/numpy/core/overrides.py", line 46, in <module>

""")

RuntimeError: implement_array_function method already has a docstring

Error in atexit._run_exitfuncs:

Traceback (most recent call last):

File "<frozen importlib._bootstrap>", line 983, in _find_and_load

File "<frozen importlib._bootstrap>", line 953, in _find_and_load_unlocked

File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed

File "/home/nkumar/.conda-envs/Adapt/lib/python3.7/site-packages/sklearn/__init__.py", line 64, in <module>

from .base import clone

File "/home/nkumar/.conda-envs/Adapt/lib/python3.7/site-packages/sklearn/base.py", line 11, in <module>

import numpy as np

File "/home/nkumar/.conda-envs/Adapt/lib/python3.7/site-packages/numpy/__init__.py", line 142, in <module>

from . import core

File "/home/nkumar/.conda-envs/Adapt/lib/python3.7/site-packages/numpy/core/__init__.py", line 40, in <module>

from . import multiarray

File "/home/nkumar/.conda-envs/Adapt/lib/python3.7/site-packages/numpy/core/multiarray.py", line 12, in <module>

from . import overrides

File "/home/nkumar/.conda-envs/Adapt/lib/python3.7/site-packages/numpy/core/overrides.py", line 46, in <module>

""")

RuntimeError: implement_array_function method already has a docstring

Error in atexit._run_exitfuncs:

Traceback (most recent call last):

File "<frozen importlib._bootstrap>", line 983, in _find_and_load

File "<frozen importlib._bootstrap>", line 953, in _find_and_load_unlocked

File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed

File "/home/nkumar/.conda-envs/Adapt/lib/python3.7/site-packages/sklearn/__init__.py", line 64, in <module>

from .base import clone

File "/home/nkumar/.conda-envs/Adapt/lib/python3.7/site-packages/sklearn/base.py", line 11, in <module>

import numpy as np

File "/home/nkumar/.conda-envs/Adapt/lib/python3.7/site-packages/numpy/__init__.py", line 142, in <module>

from . import core

File "/home/nkumar/.conda-envs/Adapt/lib/python3.7/site-packages/numpy/core/__init__.py", line 40, in <module>

from . import multiarray

File "/home/nkumar/.conda-envs/Adapt/lib/python3.7/site-packages/numpy/core/multiarray.py", line 12, in <module>

from . import overrides

File "/home/nkumar/.conda-envs/Adapt/lib/python3.7/site-packages/numpy/core/overrides.py", line 46, in <module>

""")

RuntimeError: implement_array_function method already has a docstring

Error in atexit._run_exitfuncs:

Traceback (most recent call last):

File "<frozen importlib._bootstrap>", line 983, in _find_and_load

File "<frozen importlib._bootstrap>", line 953, in _find_and_load_unlocked

File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed

File "/home/nkumar/.conda-envs/Adapt/lib/python3.7/site-packages/sklearn/__init__.py", line 64, in <module>

from .base import clone

File "/home/nkumar/.conda-envs/Adapt/lib/python3.7/site-packages/sklearn/base.py", line 11, in <module>

import numpy as np

File "/home/nkumar/.conda-envs/Adapt/lib/python3.7/site-packages/numpy/__init__.py", line 142, in <module>

from . import core

File "/home/nkumar/.conda-envs/Adapt/lib/python3.7/site-packages/numpy/core/__init__.py", line 40, in <module>

from . import multiarray

File "/home/nkumar/.conda-envs/Adapt/lib/python3.7/site-packages/numpy/core/multiarray.py", line 12, in <module>

from . import overrides

File "/home/nkumar/.conda-envs/Adapt/lib/python3.7/site-packages/numpy/core/overrides.py", line 46, in <module>

""")

RuntimeError: implement_array_function method already has a docstring

Error in atexit._run_exitfuncs:

Traceback (most recent call last):

File "<frozen importlib._bootstrap>", line 983, in _find_and_load

File "<frozen importlib._bootstrap>", line 953, in _find_and_load_unlocked

File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed

File "/home/nkumar/.conda-envs/Adapt/lib/python3.7/site-packages/sklearn/__init__.py", line 64, in <module>

from .base import clone

File "/home/nkumar/.conda-envs/Adapt/lib/python3.7/site-packages/sklearn/base.py", line 11, in <module>

import numpy as np

File "/home/nkumar/.conda-envs/Adapt/lib/python3.7/site-packages/numpy/__init__.py", line 142, in <module>

from . import core

File "/home/nkumar/.conda-envs/Adapt/lib/python3.7/site-packages/numpy/core/__init__.py", line 40, in <module>

from . import multiarray

File "/home/nkumar/.conda-envs/Adapt/lib/python3.7/site-packages/numpy/core/multiarray.py", line 12, in <module>

from . import overrides

File "/home/nkumar/.conda-envs/Adapt/lib/python3.7/site-packages/numpy/core/overrides.py", line 46, in <module>

""")

RuntimeError: implement_array_function method already has a docstring

Error in atexit._run_exitfuncs:

Traceback (most recent call last):

File "<frozen importlib._bootstrap>", line 983, in _find_and_load

File "<frozen importlib._bootstrap>", line 953, in _find_and_load_unlocked

File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed

File "/home/nkumar/.conda-envs/Adapt/lib/python3.7/site-packages/sklearn/__init__.py", line 64, in <module>

from .base import clone

File "/home/nkumar/.conda-envs/Adapt/lib/python3.7/site-packages/sklearn/base.py", line 11, in <module>

import numpy as np

File "/home/nkumar/.conda-envs/Adapt/lib/python3.7/site-packages/numpy/__init__.py", line 142, in <module>

from . import core

File "/home/nkumar/.conda-envs/Adapt/lib/python3.7/site-packages/numpy/core/__init__.py", line 40, in <module>

from . import multiarray

File "/home/nkumar/.conda-envs/Adapt/lib/python3.7/site-packages/numpy/core/multiarray.py", line 12, in <module>

from . import overrides

File "/home/nkumar/.conda-envs/Adapt/lib/python3.7/site-packages/numpy/core/overrides.py", line 46, in <module>

""")

RuntimeError: implement_array_function method already has a docstring

====================================================================================================================

Alexander Dunn

unread,

Aug 30, 2019, 6:26:46 PM8/30/19

to fireworkflows

Hi Nitin,

I can't reproduce this error locally or on our continuous integration platform, but I vaguely remember it in from a few months past. This might be a numpy error due to not building numpy correctly.

Firstly, are you using Python 2.7.13? See this known numpy issue https://github.com/numpy/numpy/issues/13430

Secondarily, could you list the following information for me?

Your operating system (including version)

Your numpy version

Your mongodb and pymongo versions

Your Python version

I believe this is an artifact of testing/debugging and should have no effect on actual use of rocketsled.

Thanks,

Alex

Nitin Kumar

unread,

Aug 30, 2019, 6:58:22 PM8/30/19

to fireworkflows

Hi Alex,

I'm using:

CentOS Linux 7

numpy 1.16.3

mongodb 4.0.3

pymongo 3.7.2

Python 3.7.3

I went ahead and tested the 'basic.py' that is given in the tutorial. I got the following error(I don't think it relates to previously mentioned issue):

===================================================================

python basic.py

2019-08-30 16:08:43,375 INFO Performing db tune-up

2019-08-30 16:08:43,509 INFO LaunchPad was RESET.

2019-08-30 16:08:43,509 INFO Optimization collection opt_default hard reset.

Traceback (most recent call last):

File "basic.py", line 93, in <module>

mc.configure(wf_creator=wf_creator, dimensions=x_dim)

File "/home/nkumar/.conda-envs/Adapt/lib/python3.7/site-packages/rocketsled/control.py", line 220, in configure

wf_creator = serialize(wf_creator)

File "/home/nkumar/.conda-envs/Adapt/lib/python3.7/site-packages/rocketsled/utils.py", line 126, in serialize

raise ImportError("{} couldn't be serialized to be imported. Are "

ImportError: {} couldn't be serialized to be imported. Are you sure it's module is in your PYTHONPATH?

===================================================================

Nitin

Alexander Dunn

unread,

Aug 30, 2019, 7:24:59 PM8/30/19

to fireworkflows

Hey Nitin,

For your first error, pip install numpy==1.17.0 and let me know if that solves the problem.

------------------------------------

Your second error is unrelated, and originates from rocketsled not being able to find the module you are currently running.

Two questions should clear this up:

1. What is the full path of the basic.py file you are executing?

2. Did you pypi install rocketsled or install it by downloading from git?

Thanks,

Alex

Nitin Kumar

unread,

Sep 3, 2019, 2:10:28 PM9/3/19

to fireworkflows

Thanks for the pointers Alex. Both issues are resolved!

numpy error fixed itself after I uninstalled and reinstalled numpy 1.16.3

The other error was caused by executing it outside the rocketsled directory.

Alexander Dunn

unread,

Sep 3, 2019, 2:45:58 PM9/3/19

to fireworkflows

Hey Nitin,

Great!

As a general guideline, when you are defining/running workflow creators, they should generally work even if they are in a package outside rocketsled. They will most of the time work if they are outside an installed package as well (e.g., some random .py file in your downloads), but this is not recommended.

In general, if passing the wf_creator function object does not work, try using the string path as it is a bit more reliable.

Check out the comprehensive guide docs for some examples of it (ctrl+F for "wf_creator"), and please let me know if you have any trouble with this when using to run your actual calculations!