Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upgrade NumPy to >=2.1.0 #244

Closed
AlexKurek opened this issue Jan 27, 2025 · 4 comments
Closed

Upgrade NumPy to >=2.1.0 #244

AlexKurek opened this issue Jan 27, 2025 · 4 comments

Comments

@AlexKurek
Copy link
Contributor

AlexKurek commented Jan 27, 2025

Feature description
For latest NumPy (2.2.2):
Image
Compare to the upper plot here: #222 (comment).
NumPy (2.2.2) is faster, in some cases >2x.
Upgrading NumPy to >=2.2.0 seems to be the only thing worth doing for NumPy at the moment.
Code:

### no MKL, latest NumPy
python -m venv nomkl_latestnumpy
source nomkl_latestnumpy/bin/activate

pip install numpy
pip show numpy
pip install setuptools PyQt5 pygount scipy

cd npbench/
python run_framework.py -f numpy

pip install pandas matplotlib
python plot_results.py

deactivate
cd ..

Related: #240.

@AlexKurek
Copy link
Contributor Author

AlexKurek commented Jan 27, 2025

Currently trying to build Fedora 41 crashes on Numba:

Collecting numba<0.61,>=0.60 (from codex-africanus[dask]->-r /opt/lofar/requirements.txt (line 21))
[...]
RuntimeError: Cannot install on Python version 3.13.1; only versions >=3.9,<3.13 are supported.

Either way, codex-africanus does built manually in Python 3.13. Tagging @sjperkins.

@tikk3r
Copy link
Owner

tikk3r commented Jan 27, 2025

Numpy 2 is a major pain, so I'm not eager to update just yet. It can be reopened once the ecosystem stabilised around it a bit more.

Also, please be mindful about whether tagging developers of packages is really necessary. The installation problem doesn't seem relevant to this issue (numpy 2 and Python 3.13 are two separate things to tackle), but also these containers are not a hard reference for stuff working or not working and are not affiliated to any of the packages included. I don't want this repository to become a source of noise for them. Issues are best raised on their own repositories and with the respective package's recommended method of installation.

@tikk3r tikk3r closed this as not planned Won't fix, can't repro, duplicate, stale Jan 27, 2025
@AlexKurek
Copy link
Contributor Author

Just to show you for the future - Numpy 2.2.2 compiled with mkl is even faster than without it:
Image

@AlexKurek
Copy link
Contributor Author

AlexKurek commented Jan 30, 2025

I tried using Python 3.13.1 with GIL enabled. Its more or less the same as on the plot above (Python 12.7).
EDIT:
Building using Python 3.13.1 with GIL disabled crashes.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants