Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

parallel python tools to consider #70

Open
paciorek opened this issue Oct 3, 2015 · 1 comment
Open

parallel python tools to consider #70

paciorek opened this issue Oct 3, 2015 · 1 comment
Labels
enhancement

Comments

@paciorek
Copy link
Contributor

paciorek commented Oct 3, 2015

might consider joblib for shared memory and ipython parallel tools for distributed. Currently we have multiprocessing (which comes installed by default) and pp installed for shared memory and pp for distributed.
@davclark
Copy link
Contributor

davclark commented Nov 5, 2015

Check out dask?

And certainly PySpark! (the full spark stack is installable with conda)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@davclark @paciorek