Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Python][Packaging] Stop uploading nightly wheels to gemfury #43904

Open
raulcd opened this issue Sep 2, 2024 · 5 comments
Open

[Python][Packaging] Stop uploading nightly wheels to gemfury #43904

raulcd opened this issue Sep 2, 2024 · 5 comments

Comments

@raulcd
Copy link
Member

raulcd commented Sep 2, 2024

Describe the enhancement requested

Once we start uploading nightly wheels to the scientific python channel on anaconda:

we can drop uploading wheels to gemfury. We should also update any documentation about nightly wheels if any.

Component(s)

Packaging, Python

@jorisvandenbossche
Copy link
Member

I think we should probably keep it for some time on both, and at least start with documenting the new index url as soon as possible.

(for example at least keep until 18.0 is released, when the stable docs will have the updated url)

@raulcd
Copy link
Member Author

raulcd commented Jan 15, 2025

We don't seem to have updated the documentation on the new index URL, we should try update it for the next release.

@amoeba
Copy link
Member

amoeba commented Jan 16, 2025

I filed an issue to document the new index URL, #45288, and just put up a patch for it, #45289. So the new text can land in Arrow 20.0.0.

Do we have any sense of whether Gemfury is being used at all? I'm not totally sure we'd have to wait until the release after 20.0.0 to remove Gemfury from CI considering how we present it to users. Either way, I'm happy to follow-up with a PR removing Gemfury after #45288 is resolved.

@jorisvandenbossche
Copy link
Member

Do we have any sense of whether Gemfury is being used at all?

It is certainly being used by a bunch of projects to test the dev version of pyarrow. For example https://github.com/search?q=https%3A%2F%2Fpypi.fury.io%2Farrow-nightlies%2F&type=code

@amoeba
Copy link
Member

amoeba commented Jan 17, 2025

Good call on doing that search. If we just stop uploading to gemfury and those projects don't migrate, I guess they'll think they're testing against a recent PyArrow nightly when they're actually just getting the last version we published to gemfury which could be very out of date. Maybe we can do the following:

  1. Stop uploading nightly wheels to gemfury
  2. Post to the dev list (using careful language to make it clear the nightlies aren't an official release, etc, etc)
  3. Filter through that GitHub search and identify repos to file issues against to notify of the change and give them a cutoff date
  4. Disable/delete or otherwise remove the arrow-nightlies index so installs against it fail. This would be done

Is that too much? If it sounds good, I can take on 1, 2, and 3 if someone with credentials can do 4 when the time comes.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants