Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow HDF5 plugin to append new NDArrays to existing HDF5 archive #403

Open
KedoKudo opened this issue Apr 24, 2019 · 3 comments
Open

Allow HDF5 plugin to append new NDArrays to existing HDF5 archive #403

KedoKudo opened this issue Apr 24, 2019 · 3 comments

Comments

@KedoKudo
Copy link

The current HDF5 plugin in the ADCore does not seem to support appending new group/dataset to existing HDF5 archive as it will always overwrite the whole file if the file exists. Given that there are some experiments with multiple scans that are better separated into different groups, it would be really helpful to add a new option in the HDF plugin to allow adding new group/dataset to existing HDF5 archive.

@MarkRivers
Copy link
Member

That would be a major change. I would be happy to look at a pull request if you want to work on it.

@GDYendell
Copy link
Contributor

Is it possible to achieve what you want with a VDS? You can write separate files and then combine them so that it looks it was all written to the same file.

https://support.hdfgroup.org/HDF5/docNewFeatures/NewFeaturesVirtualDatasetDocs.html

@KedoKudo
Copy link
Author

That is the workaround solution we are considering to use for the short term. However, having a single HDF5 archive as the direct output from the area detector is much better when it comes to managing the experiment data.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants