Releases: datalad/datalad-crawler
Releases · datalad/datalad-crawler
0.6.0 (Jul 13, 2020) -- Honoring Kyle (who never adds a release "name")
- ENH: fix enabling special remotes when working ith recent (as of 202006) git-annex - NF: gh (for github) and xnat crawler pipelines
0.5.0 (Feb 27, 2020) -- Future is bright
- DataLad 0.12 is now minimal version. Codebase is now compatible with current DataLad 0.12.2-293-gd5fcb4833 - uses less of GitPython functionality - OpenfMRI pipeline tests "relaxed" (no commit counts etc) - s3 node - be robust in case of no previous version-id known
0.4.4 (Nov 20, 2019) -- ... despite some mocking
- ENH: `s3_simple` pipeline got additional option `drop_immediately` to drop files immediately upon having them annexed - RF: `mock` is explicitly listed as a dependency for testing since DataLad 0.12.x will be PY3 only and could use built-in `unittest.mock`
0.4.3 (Oct 30, 2019) -- ... and help each other
- MNT: More changes for compatibility with developmental DataLad (#62)
0.4.2 (Oct 30, 2019) -- Friends should stick together
- BF: Prevent sorting error on missing attribute (#45) - BF: enclose "if else" into () since it has lower precedence than + (#43) - MNT: Adjust imports for compatibility with developmental DataLad (#53) - MNT: Update save() call for compatibility with new save (#42)
0.4.1 (Jun 20, 2019) -- Let us all stay friends
- Compatibility layer with 0.12 series of DataLad changing API (no backend option for `create`)
0.4 (Mar 14, 2019) -- There is more to life than a Pi
Primarily a variety of fixes and small enhancements. The only notable change is stripping away testing/support of git-annex direct mode. - do not depend on a release candidate of the DataLad, since PIP then opens the way to a RCs for any later releases to be installed - `simple_with_archives` - issue warning if incoming_pipeline has Annexificator but no `annex` is given - `crcns` - skip (but warn if relevant) records without xml - do not crash while saving updated crawler's URL db to the file which is annexed.
0.3 (Feb 06, 2019) -- Happy New Year
Primarily a variety of fixes - `crcns` crawler now uses new datacite interface - `openfmri` crawler uses legacy.openfmri.org - `simple_with_archives` - by default now also match pure .gz files to be downloaded - `archives_re` option provides regex for archives files (so `.gz` could be added if needed) - will now run with `tarballs=False` - `add_annex_to_incoming_pipeline` to state either to add `annex` to the incoming pipeline - new `stanford_lib` pipeline - aggregation of metadata explicitly invokes incremental mode - tests - variety of tests lost their `@known_failure_v6` and now tollerant to upcoming datalad 0.11.2
0.2: 02 (May 17, 2018) -- The other Release
- All non-master branches in the pipelines now will initiate from master branch, not detached. That should allow to inherit .gitattributes settings of the entire dataset
The release
0.1 (May 11, 2018) -- The Release
- First release as a DataLad extension. Functionality remains identical
to DataLad 0.10.0.rc2