Modin on raspberry pi

[jeffrey...@gmail.com]

Modin fails to install using pip on a raspberry pi3 b/c of unresolved dependencies on Ray. The specific error follows.

pi@dev:~ $ pip install modin

Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple

Collecting modin

  Downloading https://files.pythonhosted.org/packages/c9/2e/ca4b58c6b9cc14304fe2d6dd806e9c823f40fca3505da9627f7a9662bb2f/modin-0.5.4-py3-none-any.whl (228kB)

    100% |████████████████████████████████| 235kB 3.4MB/s 

Collecting pandas==0.24.2 (from modin)

  Downloading https://files.pythonhosted.org/packages/b2/4c/b6f966ac91c5670ba4ef0b0b5613b5379e3c7abdfad4e7b89a87d73bae13/pandas-0.24.2.tar.gz (11.8MB)

    100% |████████████████████████████████| 11.8MB 868kB/s 

Collecting ray==0.7.1 (from modin)

  Could not find a version that satisfies the requirement ray==0.7.1 (from modin) (from versions: )

No matching distribution found for ray==0.7.1 (from modin)

I am using an Anaconda environment for raspberry pi3 (berryconda3), and the pip version is under the control of conda, viz.

pi@dev:~ $ which pip

/home/pi/berryconda3/bin/pip

Is there any support for Modin on such embedded platforms? Can this be done without building modules from source? (I need to share applications with collaborators and do not want to have them go through lower-level steps of building from source.)

Thank you.

Best Regards,

Jeffrey

[Devin Petersohn]

Hi Jeffrey,

It is possible to use pip do to this with `pip install --no-deps modin`. We do use Ray by default to parallelize the computation, but we do have ongoing efforts to add additional runtimes to parallelize the computation: https://github.com/modin-project/modin/pull/732. You should be able to just run `pip install --no-deps git+https://github.com/devin-petersohn/modin@engines/dask_futures_init`. You will have to set the environment variable to let Modin know to use Dask: `export MODIN_ENGINE=dask`. Then it should just work with Dask instead of Ray. The complexity in the installation comes from it being a WIP, and I have tested that branch so it should work. If you need something that is convenient to share it should be straightforward to create an install script. You will need pandas as well for that.

If you'd like to request that Ray start supporting embedded platforms, there is a mailing list for Ray as well: https://groups.google.com/forum/#!forum/ray-dev.

Devin

--
You received this message because you are subscribed to the Google Groups "modin-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to modin-dev+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/modin-dev/dd94f0b1-cefd-4b6c-9677-a19de65d53d5%40googlegroups.com.