Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Extraction should fallback on NCDatasets.jl types #2

Closed
Balinus opened this issue Jan 11, 2020 · 2 comments
Closed

Extraction should fallback on NCDatasets.jl types #2

Balinus opened this issue Jan 11, 2020 · 2 comments
Labels
enhancement New feature or request help wanted Extra attention is needed
Milestone

Comments

@Balinus
Copy link
Member

Balinus commented Jan 11, 2020

Context
When ClimateTools was designed (3 years ago already!) there was not a lot of options for Geographic types and quite less for climate data. From this perspective, the ClimGrid type was born. However, there is a lack of performance for the extraction of the data from netCDF files but also no support for on-disk datasets (data too large for the available RAM).

Challenge
The challenge will be to align the ClimGrid type with the CFVariable available in NCDatasets.jl. So, either we simply scratch the ClimGrid type found in ClimateBase and replace it with CFVariable (or NCDataset?). There is now some work done in NCDatasets.jl for multiple files dataset and datasets that are too large to fit in RAM and we perhaps should now look into it for a 1.0 release of ClimateTools.

Why
Now that the extraction ecosystem is mature, ClimateTools should now concentrate on climate analysis algorithms (bias correction, etc) and not on the extraction of datasets.

Idea
The API between ClimateTools and NCDatasets.jl should reside in ClimateBase. I'm also posting over there.

Any help, idea would be appreciated!

See also over ClimateTools: JuliaClimate/ClimateTools.jl#119

@Balinus Balinus added enhancement New feature or request help wanted Extra attention is needed labels Jan 11, 2020
@Balinus Balinus added this to the 1.0 milestone Jan 11, 2020
@Balinus
Copy link
Member Author

Balinus commented Jan 22, 2020

See #4 for some discussions.

@Datseris
Copy link
Member

Currently we have functions for loading directly from .nc files using NCDatasets.jl.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

2 participants