Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

NWM 1km LDAS rechunked dataset #233

Open
wants to merge 19 commits into
base: master
Choose a base branch
from

Conversation

rsignell-usgs
Copy link
Contributor

NWM 1km reanalysis gridded output, rechunked for superior time series extraction

@rsignell-usgs
Copy link
Contributor Author

pre-commit.ci autofix

@rsignell-usgs
Copy link
Contributor Author

I got "push permission was denied -- perhaps the PR was made from an organization?".
Yep, it was. I guess I'll close this PR and submit from my user account.

@rsignell-usgs
Copy link
Contributor Author

pre-commit.ci autofix

1 similar comment
@rsignell-usgs
Copy link
Contributor Author

pre-commit.ci autofix

@rsignell-usgs
Copy link
Contributor Author

rsignell-usgs commented Dec 15, 2022

@cisaacstern and other Pangeo-Forge Gurus,

How do I remove the reference_time variable in the recipe call?

( Shown in cell [20] of my local recipe run here:
https://gist.github.com/rsignell-usgs/195857e77dbad540425f0636e753dffb)

@cisaacstern
Copy link
Member

@rsignell-usgs based on cell [11] of your linked notebook, it looks like this variable is part of the original files, so it's just being passed through to the output dataset.

If you'd prefer to drop it, you can use a preprocessor function. A more complicated preprocessor is demonstrated here. In your case, it could be something like:

def preprocess(ds):
    return ds.drop("reference_time")

recipe = XarrayZarrRecipe(
    ...
    process_chunk=preprocess,
)

@rsignell-usgs
Copy link
Contributor Author

pre-commit.ci autofix

@rsignell-usgs
Copy link
Contributor Author

pre-commit.ci autofix

@rsignell-usgs
Copy link
Contributor Author

/run NWM-2.1-grid1km-LDAS-rechunked

@pangeo-forge
Copy link
Contributor

pangeo-forge bot commented Dec 16, 2022

The test failed, but I'm sure we can find out why!

Pangeo Forge maintainers are working diligently to provide public logs for contributors.
That feature is not quite ready yet, however, so please reach out on this thread to a
maintainer, and they'll help you diagnose the problem.

@rsignell-usgs
Copy link
Contributor Author

pre-commit.ci autofix

@rsignell-usgs
Copy link
Contributor Author

/run NWM-2.1-grid1km-LDAS-rechunked

@pangeo-forge
Copy link
Contributor

pangeo-forge bot commented Dec 16, 2022

The test failed, but I'm sure we can find out why!

Pangeo Forge maintainers are working diligently to provide public logs for contributors.
That feature is not quite ready yet, however, so please reach out on this thread to a
maintainer, and they'll help you diagnose the problem.

@rsignell-usgs
Copy link
Contributor Author

@cisaacstern , I accepted your suggested changes (pretty cool!) and the recipe looks okay, but still failing.

@rsignell-usgs
Copy link
Contributor Author

pre-commit.ci autofix

@rsignell-usgs
Copy link
Contributor Author

rsignell-usgs commented Dec 19, 2022

@sharkinsspatial is this National Water Model reanalysis 1km grid recipe one that your team could help out with?

I'm hoping the answer is YES, since it's:

  • AWS
  • NODD

@rsignell-usgs
Copy link
Contributor Author

/run NWM-2.1-grid1km-LDAS-rechunked

@pangeo-forge
Copy link
Contributor

pangeo-forge bot commented Dec 19, 2022

The test failed, but I'm sure we can find out why!

Pangeo Forge maintainers are working diligently to provide public logs for contributors.
That feature is not quite ready yet, however, so please reach out on this thread to a
maintainer, and they'll help you diagnose the problem.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants