Towards WinPython 2021-03

stonebig

unread,

May 10, 2021, 2:29:53 PM5/10/21

to WinPython

The WinPython 2021-03 build1 is out for a release end june 2021.

This cycle aims to:

- introduce a PyPy3 branch, with PyPy (a JIT Python) instead of cPython inside,

- publish a big Python-3.10 beta branch,

- continue on Jupyterlab journey with Jupyterlab-3.1,

- Push on Data Engineering, Web technology, Integrated ML

- Explore Qt-6 options.

Changes from WinPython 2021-02:

- Infrastructure:

- Python-7.3.10 on PyPy3-7.3.5**rc2**

- Python-3.8.10, Python-3.9.5,

- Python-3.10.0b1,

- pip-21.1.1

- New Packages:

- matplotlib_inline-0.1.2

- Upgraded Packages:

- VSCode-1.56.0.0

- Matplotlib-3.4.2, scikit_learn-0.24.2, scipy-1.6.3, xarray-0.18.0

- variation per version:

- no Qt nor ML nor Jupyter package in PyPy3 versions yet,

- Pytorch in standard branch only,

- portable VSCode in "cod" branch only. (but you can copy the "\t\cod" directory from one to the other)

Areas of particular interest for testers:

- Winpython version pypy3 (in there, type pypy3 instead of python to call the interpreter)

- python-3.10.0b1

Remark:

- a big PyPy3 distro was build, but without the "Jupyter" nor "Qt" nor "cython" packages yet it was felt too much incomplete ... so it will wait next round, as "you never have a second chance to make a first impression".

Thanks to the <detail> markdown tag, you can see a full detail of Build1 packages in https://github.com/winpython/winpython/issues/953#issuecomment-830821713

## hash codes

MD5 | SHA-1 | SHA-256 | Binary | Size | SHA3-256

---------------------------------|------------------------------------------|------------------------------------------------------------------|-----------------------------------|--------------------|------------------------------------------------------------------

31e370ecd303fe216ba682383e3ec39a | d2ad834d2d09a28028247fc6ecb569e8815faf7a | 041a2452c111e4ad0a357607c5dd7c0fe3b2469b349591d7ec0e8dfcff55e2e1 | Winpython64-3.7.10.0dotPyPyb1.exe | 25 227 738 Bytes | 1fd39b18a97475e3fb704ffae13b2f12689cc1534df329eaa9faea2b6dbed4a1

stonebig

unread,

May 23, 2021, 1:46:49 PM5/23/21

to WinPython

Hello,

The WinPython 2021-03 build2 is out !

Effort was on PyPy3 and Flask-2.0

Changes from WinPython 2021-03 build1:

- Infrastructure:

- Python-7.3.10 on PyPy3-7.3.5 final

- pip-21.1.2

- a big (Work-In-Progress) PyPy3 version, still full of compatibility bugs to iron out:

- 408 packages included (out of 520 in a Cpython version)

- is ok: Numpy, Scipy, Matplotlib, Pandas, seaborn, sympy, holoviews

- is not yet ok:

- jupyter_core because of pywin32 dependancy on [three functions to re-write using ctypes ](https://github.com/jupyter/jupyter_core/issues/226#issuecomment-846453917) instead, and a [PyPy3 old miss](https://foss.heptapod.net/pypy/pypy/-/issues/3469)

- statsmodels has apparently an uncompatible practice with [its "docstring" ](https://github.com/statsmodels/statsmodels/issues/7460)

- is missing: Qt Stack (but [under investigation per Qt Company](https://gitter.im/PySide/pyside2?at=60a62a3477c281623c689b81) )

- New Packages:

- csvs_to_sqlite , datasette_graphql, sqlite_utils

- python_picard

- Upgraded Packages:

- jupyterlab-3.0.15, spyder-5.0.3, bokeh-2.3.2

- Flask-2.0

- xlwings-0.23.3, dask-2021.5.0

- variation per version:

- no Qt nor ML package in PyPy3 versions yet,

- Pytorch in standard branch only,

- portable VSCode in "cod" branch only. (but you can copy the "\t\cod" directory from one to the other)

Areas of particular interest for testers:

- finding and narrowing down issues in PyPy3 version (some are PyPy3 issues, some are packages issues, but issues shall be identified to be nailed down).

- PyPy3 issues or non-understood issues are to report there: https://foss.heptapod.net/pypy/pypy/-/issues?sort=updated_desc

- packages issues with PyPy3 are to check also on their issue list are sometimes already created, like [here for Matplotlib

](https://github.com/winpython/winpython/issues/953)

- for jupyter, the ironing out threads are there https://github.com/jupyter/jupyter_core/issues/226#issuecomment-846453917 and there https://foss.heptapod.net/pypy/pypy/-/issues/3469

Next build effort:

- pushing on PyPy3 pain points :

- statsmodels incompatible practice

- jupyter_core pywin32 replacement

- pyside6-6.1 for PyPy3 investigation

- slow parts of PyPy3 vs PyPy2

- slow parts of PyPy3 vs standard cPython

- lag vs cPython-3.9

## hash codes

MD5 | SHA-1 | SHA-256 | Binary | Size | SHA3-256

---------------------------------|------------------------------------------|------------------------------------------------------------------|-----------------------------------|--------------------|------------------------------------------------------------------

e102698c1750f525ed9c3b45a7d54f48 | 89fc4b4a4f213f1ffc7606fe37f102d09531ba5f | 5884c7967b2567e3248df44b1d7f9b53ef3afc6f824a0d0013c2246a59ea7ecd | Winpython64-3.7.10.0dotPyPyb2.exe | 25 693 798 Bytes | a6f2769195268ab38eb1059c90aa5551960c55301d43ff145afc23b427400c85

cc03c21f42d1c0510dad50cfff68240e | 508d6f445e1d47ddb94e623d853326884bec6b01 | d85667894857543149fe5fc12944bbce8698772b8a0c639bb38cd1d15ec80227 | Winpython64-3.7.10.0PyPyb2.exe | 430 515 205 Bytes | e9e08132d644100ffdfdcf18f7296f3ceea88bc1111940ed325573dd4c4d1405

stonebig

unread,

May 30, 2021, 6:48:31 AM5/30/21

to WinPython

Hi all,

The WinPython 2021-03 build3 is out !

Effort continues on PyPy3, with two milestone successes:

- it's working on Jupyter !

- only 100 packages missing to reach parity with cPython (420 vs 520 packages, less than 20%)

Changes from WinPython 2021-03 build2:

- Infrastructure:

- PyPy3 progress:

- 420 packages are ok, especially : Jupyterlab + Jupyter Notebook, statsmodels, plotnine

- hint of some core dev interest on [writing performant Python code for PyPy](https://twitter.com/cfbolz/status/1398352941849907203)

Interest for users:

- helping iron out next issues (discovered or to discover) at this new stage :

. https://foss.heptapod.net/pypy/pypy/-/issues/3476 or https://github.com/krassowski/jupyterlab-lsp/issues/610

Next builds effort:

- pushing further on PyPy3 pain points :

- PyPy-7.3.6 will suppress some slow behaviours on pure Python Code: import of modules, close of files, list mutation ...

- Qt Stack ([pyside6-6.1 for PyPy3 under investigation per Qt Company](https://gitter.im/PySide/pyside2?at=60a62a3477c281623c689b81) )

- pushing PyPy to reduce its lag of being on 3.7:

- 3.8 will provide typed-ast

- lag reduction will increase core Developer interest and "big money" from the general Python "speed-up" effort.

MD5 | SHA-1 | SHA-256 | Binary | Size | SHA3-256

---------------------------------|------------------------------------------|------------------------------------------------------------------|-----------------------------------|--------------------|------------------------------------------------------------------

0d8d10133b0d45ceb86e7d173a190337 | 66fcc8d4868e8fcc815573cff1dc6001680c4215 | c63da802ea39f51ec2f321cbcc18dd8cdbda66a52e81ae6fcfba4ece68ca79ab | Winpython64-3.7.10.0PyPyb3.exe | 437 356 017 Bytes | b8a012634c76119f14c595d232414bafe70b50ce1a19957213ca3eddb604bab3

775f2a7b4aab11ba13055656f0536cba | 394997e7fc377fca028f1792b704a5f4adaf796b | cebe8f17111dfd9a1f5d112b3e75fb5682dfc7f39026efa827b01d8c20d4ed37 | Winpython64-3.7.10.0dotPyPyb3.exe | 25 716 848 Bytes | 3311887e1e71cb5e22c9354c4c2b3e0fe3f6c240ce0e81f10979ae5667c8707c

stonebig

unread,

Jun 6, 2021, 4:27:12 PM6/6/21

to WinPython

Hi All,

The WinPython 2021-03 build 4 is out !

Changes from WinPython 2021-03 build3:

- Infrastructure:

- PyPy3 (python-3.7) progressing as [hoped](https://github.com/winpython/winpython/issues/966#issue-861977495) :

- 440 packages are ok, notable newcomers:

- ceODBC, pypyodbc,

- rasterio, fiona , pyproj, python_snappy, pywinusb, astropy, cytoolz, fast_histogram, llvmlite, mpl_scatter_density,

- wordcloud, astroml, h5py, GitPython, cached-property, gitdb, jupyterlab-git, nbdime

- PyPy3 with 'natural' VsCode detection currently requires to copy pypy3.exe as python.exe, a temporary hack

- New Packages:

- maturin is now inside all big versions

- Upgrade Packages:

- jupyterlab-3.0.16, notebook-6.4.0

- pygit2-1.6.0, GDAL-3.3.0, datasette-0.57

Interest for users:

- the goal for WinPython 2021-03 PyPy3 is achieved https://github.com/winpython/winpython/issues/966#issue-861977495 ...

- ... please help iron out next issues (discovered or to discover) at this new PyPy3 stage :

- solving "Shapely" , "orjson" and "reportlab" problems would be [helpfull ](https://github.com/winpython/winpython/issues/966#issuecomment-855238265)

- the PyPy3 team needs support and help in any form to speed-up further and get more momentum

Next build effort:

- pushing on PyPy3 next pain points :

- missing: "Shapely" , "orjson" and "reportlab" packages (or a replacement, like for PyODBC),

- coming:

- PyPy-7.3.6 to suppress some slow behaviour vs cPython Code: import of modules, close of files, list mutation ...

- Qt Stack ([pyside6-6.1 for PyPy3 under investigation per Qt Company](https://gitter.im/PySide/pyside2?at=60a62a3477c281623c689b81) )

- some PyPy3 progress [towards 3.8 compatibility](https://twitter.com/cfbolz/status/1401199542700236814) ), that will bring typed_ast

MD5 | SHA-1 | SHA-256 | Binary | Size | SHA3-256

---------------------------------|------------------------------------------|------------------------------------------------------------------|-----------------------------------|--------------------|------------------------------------------------------------------

ebf4e9e614aa562a417ed6c4359e433b | 4d8e042592828eb99dcd30e8ace960f989b6b346 | d5a4215d8cd627b69d397e477ded58df984a217233cde65243891b194bc0c499 | Winpython64-3.7.10.0dotPyPyb4.exe | 25 771 409 Bytes | 148a1160d9d6083401429db4fd9326330d51d4a45cb41fcbf3df7f5a88137713

431861dc5efeb5b168d01803b0dd9b15 | f06bf478024e30a8e65a1441c9b42cc8e6086592 | f5de53fe850edfb452c5a74486f0af0d204b512e476095107c65a07fbfa29b0d | Winpython64-3.7.10.0PyPycodb4.exe | 665 714 786 Bytes | 1e0d27eb7594ebf44d500cf7d3a9053e46ad82412faef33b2667a693a3e489af

more details here: https://github.com/winpython/winpython/issues/953#issuecomment-855421857

stonebig

unread,

Jun 13, 2021, 2:39:50 PM6/13/21

to WinPython

Hi Al,,

The Winpython 2021-03 build 5 is out !

Changes from WinPython 2021-03 build4:

- Infrastructure:

- PyPy3 (python-3.7) progressing:

- 12 more packages are included:

- shapely, ipyleaflet, geopandas,

- reportlab, nbconvert_reportlab, scs, sounddevice,

- wasmer, wasmer_compiler_singlepass, wasmer_compiler_cranelift

- ... [work ongoing on PyPy for 'hpy' in Cython, Python-3.8 compatibility (may take the summer)](https://mail.python.org/pipermail/pypy-dev/2021-April/016146.html)

- New Packages:

- maturin is now inside all big versions

- Upgrade Packages:

- mypy-0.902 (will be friendly to next PyPy Python-3.8)

- numpy-1.21.0rc2 and Cython-3.0a7 for Python-3.10

Interest for users:

- check new packaged and resolved problems for PyPy3:

- shapely, reportlab, ipyleaflet, ...

- help iron out next issues (discovered or to discover) at this new PyPy3 stage :

- solving "orjson" or "cartopy" or "pyproj" problems on WinPythonChecker would be [helpfull ](https://github.com/winpython/winpython/issues/966#issuecomment-860021143)

- the PyPy3 team needs support and help in any form to speed-up further and get more momentum

Next build effort: (should be rc)

- pushing on PyPy3 next pain points :

- missing: "orjson" and "cartopy" packages (or a replacement, like for PyODBC),

- following progress on :

- PyPy-7.3.6 to suppress some slow behaviour,

- hpy integration in cython3

- wait or not: numpy-1.21, Jupyterlab-3.1

MD5 | SHA-1 | SHA-256 | Binary | Size | SHA3-256

---------------------------------|------------------------------------------|------------------------------------------------------------------|-----------------------------------|--------------------|------------------------------------------------------------------

01d46be920a98fcab642d48cc9a98e37 | 1647c9f8babd7418a389e51c8c9b0b4d94a22d33 | 06e814a35f55d7707abc498126a60af04a60f6e1a040720972f831dd234ad754 | Winpython64-3.7.10.0PyPycodb5.exe | 678 049 368 Bytes | e21d8e02490853218bf36abdd54b056ba367647154f0272ddf5e20b3038785e5

stonebig

unread,

Jun 27, 2021, 9:36:19 AM6/27/21

to WinPython

Hi all,

WinPython 2021-03 rc is out !

If no major problem is detected, these binaries will be re-tagged as final in a few days.

Main Outcome of this cycle is a PyPy branch, featuring a JIT Python-3.7 on Windows 10 64 bit:

- It has IDLE and Jupyter / VScode compatibility,

- it has not yet Qt ecosystem compatibility, nor Deep Learning modules,

- it can be slower when using some c-extensions, while in pure Python mode it can be 3x Quicker (see https://foss.heptapod.net/pypy/pypy/-/issues/3473)

- ...but it's assumed that solving the "cPython" slowness handicap:

. is equal to solve "cPython" non-JIT-ability problems in the future, (after today low-hanging fruits)

. and so is equivalent to solve the PyPy compatibility and slowness problems now.

Changes from WinPython 2021-03 build5:

- Infrastructure:

- PyPy3 (python-3.7) progressing:

- ipycanvas , pymc,, sklearn_contrib_lightning, cartopy, pyproj, reportlab

- removed the fake 'python.exe', in hope VSCode will detect 'pypy3.exe' more automatically in the future

- now we roughly have all that was possible, in wait of : pyside6-6.1 compatibility, python-3.8 compatibility, hpy, packagers making some effort.

- New Packages:

- fastai

- Upgrade Packages:

- numpy-1.21.0, scipy-1.7.0, mypy-0.910

- spyder-5.0.5, plotly-5.0.0

MD5 | SHA-1 | SHA-256 | Binary | Size | SHA3-256

---------------------------------|------------------------------------------|------------------------------------------------------------------|-----------------------------------|--------------------|------------------------------------------------------------------

fa2715d98015019192ebf728f253ae9c | ba4f263ef533df404f7c8cc0b47a6eb78f429bfa | 489ab15c35336cdac32b88a5282d7b5631af74afba34ac6cee3ac475ffd7c7dd | Winpython64-3.7.10.0dotPyPyrc.exe | 25 763 221 Bytes | 8758c48b8c74ba3621989b9abf2ddcfcd38049de21512ffcc9ae2688156508c9

819d5da22c5b2f025eba789ea3edf725 | 4e67187e3bf949ee7ab85d7fbc873f2ac7691c5a | 959d3f7a29134ec758a048217c3bee1010dd1322c98f2452b853796360b748fd | Winpython64-3.7.10.0PyPyrc.exe | 486 605 762 Bytes | a686ffa27b8cfe96aa227cec7ca1ace5da744ea969dfbdbc76c96f2c9c63d514

stonebig

unread,

Jul 4, 2021, 4:25:22 AM7/4/21

to WinPython

Hi all,

As no complaints were received since rc, WinPython 2021-03 is equal to the rc version.

Binaries have been renamed on Sourceforge, and will be uploaded to Github later this week.

MD5 | SHA-1 | SHA-256 | Binary | Size | SHA3-256

---------------------------------|------------------------------------------|------------------------------------------------------------------|-----------------------------------|--------------------|------------------------------------------------------------------

fa2715d98015019192ebf728f253ae9c | ba4f263ef533df404f7c8cc0b47a6eb78f429bfa | 489ab15c35336cdac32b88a5282d7b5631af74afba34ac6cee3ac475ffd7c7dd | Winpython64-3.7.10.0dotPyPy.exe | 25 763 221 Bytes | 8758c48b8c74ba3621989b9abf2ddcfcd38049de21512ffcc9ae2688156508c9

Reply all

Reply to author

Forward