Datacube 1.9.0-rc5 pre-release

Datacube 1.9.0 release candidate 5

Another release candidate for the 1.9.0 release.

The 1.9.0 branch will remain in pre-release until we have working 1.9-compatible versions of the following key ODC packages: datacube-explorer, datacube-ows, eodatasets, and odc-apps-dc-tools. Work on migrating these packages is underway, and this pre-release
is mostly a response to that work - applying changes intended to ease 1.8.x to 1.9.x migration.

1.9.0-rc5 also (finally) adds support for product deletion - user requests for this feature date back to early 2017 - before the project had adopted the name "Open Data Cube" (ODC) and was still known as the Australian Geoscience Data Cube (AGDC).

Changes since 1.9.0-rc4

• Update whats_new.rst, ready for 1.9.0-rc5 release (#1594)
• Expand extra dimension support, WIP (#1593)
• Ensure pre-prepared EO3 datasets can be indexed. (i.e. ensure the prep_eo3() function is idempotent) (#1591)
• The canonical name of the postgres driver is now "postgres" with "default" as an alias instead of the other way around. (#1590)
• Update docker image to GDAL 3.9/Python 3.12/Ubuntu 24.04 (#1588)
• Fix typos in docs (#1577)
• Merge in recent 1.8.x branch changes. (#1568, #1579)
• Add Product delete methods to API and command in CLI, plus misc cleanup of the surrounds (#1583)

This pre-release includes contributions from @Ariana-B, @Kirill888, @pjonsson, and @SpacemanPaul

Datacube 1.9.0-rc6 pre-release

Datacube 1.9.0 release candidate 6

Bugfix pre-release.

The 1.9.0 branch will remain in pre-release until we have working 1.9-compatible versions of the following
key ODC packages: datacube-explorer, datacube-ows, eodatasets, and odc-apps-dc-tools.
Work on migrating these packages is underway, and this pre-release addresses issues identified in
the course of that work.

Changes since 1.9.0-rc5

• Update whats_new.rst, ready for 1.9.0-rc6 release. (:pull:1598)
• Fix multi-threading race condition in config API. (:pull:1596)
• Move alembic.ini to a location where it will get installed by pip (without -e). (:pull:1597)

This pre-release includes contributions from @SpacemanPaul

Datacube 1.9.0-rc4 pre-release

Datacube 1.9.0 release candidate 4

The last new major release of the Open Data Cube was v1.8.0 in May 2020, nearly 4 years ago.

ODC developers and the Steering Council have been working hard behind the scenes over the last couple of years
to address some of the accumulated technical debt in datacube-core and prepare for new major releases.

The long-term plan includes a number of significant backwards-incompatible changes. An effort has been made to
provide a smooth migration pathway wherever possible, with existing behaviour in 1.8.x versions being deprecated
in 1.9.x, with alternatives being provided, then removing the deprecated behaviour in 2.0.x with the alternative
approaches becoming the standard, but some minor backwards incompatible changes in 1.9.x were unavoidable.

This is the first release candidate for the 1.9.x release series. Please refer to the Migration Notes document before attempting to upgrade from a 1.8 series installation.

Changes since 1.9.0-rc3:

Mostly changes to ease migration from 1.8.x

• Standardize resampling input supported to odc.geo.warp.Resampling (better odc-geo compatibility(:pull:1571)
• Refine default behaviour for config engine to support easier migration from 1.8 (:pull:1573)
• Convert legacy GeoBoxes to odc.geo GeoBoxes in the core API (:pull:1574)
• Add URL component pseudo to config layer to expose components to the api when configured as a URL,
  and reformat whats_new for 1.9.0-rc4 release. (:pull:1575)

Includes contributions from @SpacemanPaul and @snowman2

Other changes since 1.8.18:

• Merge in 1.8.x branch changes. (#1459, #1473, #1532, #1548, #1565)
• External Lineage API (#1401)
• Add lineage support to index clone operation (#1429)
• Migrate to SQLAlchemy 2.0 (#1432)
• Clean up deprecated code and add deprecation warnings to legacy methods, simplify DocReader logic (#1406)
• Mark geometry module as deprecated and replace all usage with odc-geo (#1424)
• Mark GridSpec as deprecated, replace math and cog functions with odc-geo equivalents, enforce new odc-geo conventions (#1441)
• Rename gbox to geobox in parameter names (#1441)
• Remove executor API (#1462)
• Remove ingestion methods, GridWorkflow and Tile classes (#1465)
• Fix postgis queries for numeric custom search fields (#1475)
• Document best practice for pulling in changes from develop and update constraints.txt (#1478)
• Postgis index driver performance tuning (#1480)
• Cleanup and formalise spatial index API and expose in CLI (#1481)
• Increase minimum Python version to 3.10 (#1509)
• Virtual product tests using odc-geo GridSpec (#1512)
• New Configuration API, as per ODC-EP10 (#1505)
• Alembic migrations for postgis driver (#1520)
• EP08 lineage extensions/changes to datasets.get(). (#1530)
• EP13 API changes to Index and IndexDriver. (#1534)
• EP13 API changes to metadata and product resources. (#1536)
• Phase 1 of EP13 API changes to dataset resource - get_unsafe, get_derived, temporal_extent. (#1538)
• Add product argument to spatial_extent method, as per EP13. (#1539)
• Index driver API type hint cleanup. (#1541)
• Deprecate multiple locations. (#1546)
• Deprecate search_eager and search_summaries and add archived arg to all dataset search/count methods. (#1550)
• Migrate away from deprecated Python pkg_resources module (#1558)
• Add custom_offsets and order_by arguments to search_retunrning() - order_by still unimplemented. (#1557)
• Fix and enhance typehints, automated static type checking with mypy. (#1562)
• Improve SQLAlchemy join hints, addressing an recurring but intermittent bug. (#1564)
• Improve typehints and update docstrings in datacube/api/core.py (#1567)
• Add migration notes, update documentation and whats_new.rst for 1.9.0-rc1 release (#1569)

Includes contributions from @SpacemanPaul and @Ariana-B, with assistance from @omad and @robbibt

With thanks to the Open Data Cube Steering Council and all supporting organisations, especially Geoscience Australia.

Datacube 1.9.0-rc3 pre-release

This is re-pre-release of 1.9.0-rc1 to get the github and pypi pre-release version numbering back in sync.

Datacube 1.9.0 release candidate 3

The last new major release of the Open Data Cube was v1.8.0 in May 2020, nearly 4 years ago.

ODC developers and the Steering Council have been working hard behind the scenes over the last couple of years
to address some of the accumulated technical debt in datacube-core and prepare for new major releases.

The long-term plan includes a number of significant backwards-incompatible changes. An effort has been made to
provide a smooth migration pathway wherever possible, with existing behaviour in 1.8.x versions being deprecated
in 1.9.x, with alternatives being provided, then removing the deprecated behaviour in 2.0.x with the alternative
approaches becoming the standard, but some minor backwards incompatible changes in 1.9.x were unavoidable.

This is the first release candidate for the 1.9.x release series. Please refer to the Migration Notes document before attempting to upgrade from a 1.8 series installation.

• Merge in 1.8.x branch changes. (#1459, #1473, #1532, #1548, #1565)
• External Lineage API (#1401)
• Add lineage support to index clone operation (#1429)
• Migrate to SQLAlchemy 2.0 (#1432)
• Clean up deprecated code and add deprecation warnings to legacy methods, simplify DocReader logic (#1406)
• Mark geometry module as deprecated and replace all usage with odc-geo (#1424)
• Mark GridSpec as deprecated, replace math and cog functions with odc-geo equivalents, enforce new odc-geo conventions (#1441)
• Rename gbox to geobox in parameter names (#1441)
• Remove executor API (#1462)
• Remove ingestion methods, GridWorkflow and Tile classes (#1465)
• Fix postgis queries for numeric custom search fields (#1475)
• Document best practice for pulling in changes from develop and update constraints.txt (#1478)
• Postgis index driver performance tuning (#1480)
• Cleanup and formalise spatial index API and expose in CLI (#1481)
• Increase minimum Python version to 3.10 (#1509)
• Virtual product tests using odc-geo GridSpec (#1512)
• New Configuration API, as per ODC-EP10 (#1505)
• Alembic migrations for postgis driver (#1520)
• EP08 lineage extensions/changes to datasets.get(). (#1530)
• EP13 API changes to Index and IndexDriver. (#1534)
• EP13 API changes to metadata and product resources. (#1536)
• Phase 1 of EP13 API changes to dataset resource - get_unsafe, get_derived, temporal_extent. (#1538)
• Add product argument to spatial_extent method, as per EP13. (#1539)
• Index driver API type hint cleanup. (#1541)
• Deprecate multiple locations. (#1546)
• Deprecate search_eager and search_summaries and add archived arg to all dataset search/count methods. (#1550)
• Migrate away from deprecated Python pkg_resources module (#1558)
• Add custom_offsets and order_by arguments to search_retunrning() - order_by still unimplemented. (#1557)
• Fix and enhance typehints, automated static type checking with mypy. (#1562)
• Improve SQLAlchemy join hints, addressing an recurring but intermittent bug. (#1564)
• Improve typehints and update docstrings in datacube/api/core.py (#1567)
• Add migration notes, update documentation and whats_new.rst for 1.9.0-rc1 release (#1569)

Includes contributions from @SpacemanPaul and @Ariana-B, with assistance from @omad and @robbibt

With thanks to the Open Data Cube Steering Council and all supporting organisations, especially Geoscience Australia.

Datacube 1.9.0-rc1

The last new major release of the Open Data Cube was v1.8.0 in May 2020, nearly 4 years ago.

ODC developers and the Steering Council have been working hard behind the scenes over the last couple of years
to address some of the accumulated technical debt in datacube-core and prepare for new major releases.

The long-term plan includes a number of significant backwards-incompatible changes. An effort has been made to
provide a smooth migration pathway wherever possible, with existing behaviour in 1.8.x versions being deprecated
in 1.9.x, with alternatives being provided, then removing the deprecated behaviour in 2.0.x with the alternative
approaches becoming the standard, but some minor backwards incompatible changes in 1.9.x were unavoidable.

This is the first release candidate for the 1.9.x release series. Please refer to the docs/MIGRATION-1.8-to-1.9.rst document before attempting to upgrade from a 1.8 series installation.

• Merge in 1.8.x branch changes. (#1459, #1473, #1532, #1548, #1565)
• External Lineage API (#1401)
• Add lineage support to index clone operation (#1429)
• Migrate to SQLAlchemy 2.0 (#1432)
• Clean up deprecated code and add deprecation warnings to legacy methods, simplify DocReader logic (#1406)
• Mark geometry module as deprecated and replace all usage with odc-geo (#1424)
• Mark GridSpec as deprecated, replace math and cog functions with odc-geo equivalents, enforce new odc-geo conventions (#1441)
• Rename gbox to geobox in parameter names (#1441)
• Remove executor API (#1462)
• Remove ingestion methods, GridWorkflow and Tile classes (#1465)
• Fix postgis queries for numeric custom search fields (#1475)
• Document best practice for pulling in changes from develop and update constraints.txt (#1478)
• Postgis index driver performance tuning (#1480)
• Cleanup and formalise spatial index API and expose in CLI (#1481)
• Increase minimum Python version to 3.10 (#1509)
• Virtual product tests using odc-geo GridSpec (#1512)
• New Configuration API, as per ODC-EP10 (#1505)
• Alembic migrations for postgis driver (#1520)
• EP08 lineage extensions/changes to datasets.get(). (#1530)
• EP13 API changes to Index and IndexDriver. (#1534)
• EP13 API changes to metadata and product resources. (#1536)
• Phase 1 of EP13 API changes to dataset resource - get_unsafe, get_derived, temporal_extent. (#1538)
• Add product argument to spatial_extent method, as per EP13. (#1539)
• Index driver API type hint cleanup. (#1541)
• Deprecate multiple locations. (#1546)
• Deprecate search_eager and search_summaries and add archived arg to all dataset search/count methods. (#1550)
• Migrate away from deprecated Python pkg_resources module (#1558)
• Add custom_offsets and order_by arguments to search_retunrning() - order_by still unimplemented. (#1557)
• Fix and enhance typehints, automated static type checking with mypy. (#1562)
• Improve SQLAlchemy join hints, addressing an recurring but intermittent bug. (#1564)
• Improve typehints and update docstrings in datacube/api/core.py (#1567)
• Add migration notes, update documentation and whats_new.rst for 1.9.0-rc1 release (#1569)

Includes contributions from @SpacemanPaul and @Ariana-B, with assistance from @omad and @robbibt

With thanks to the Open Data Cube Steering Council and all supporting organisations, especially Geoscience Australia.

Datacube 1.8.18

Transitional Release

1.8.18 contains bugfixes, as well as enhancements and changes to help prepare for the migration to Open Data Cube 1.9.x. This release likely contains the last significant enhancements to the 1.8.x series. The first 1.9 series release candidate will be published imminently. Future development will focus on the 1.9.x series, although 1.8.x series maintenance and bugfix releases will continue for the forseeable future.

• Add dataset cli tool find-duplicates to identify duplicate indexed datasets (#1517)
• Make solar_day() timezone aware (#1521)
• Warn if non-eo3 dataset has eo3 metadata type (#1523)
• Update pandas version in docker image to be consistent with conda environment and default to stdlib
  timezone instead of pytz when converting timestamps; automatically update copyright years (#1527)
• Update github-Dockerhub credential-passing mechanism. (#1528)
• Tweak list_products logic for getting crs and resolution values (#1535)
• Add new ODC Cheatsheet reference doc to Data Access & Analysis documentation page (#1543)
• Compatibility fix to allow users to supply odc.geo-style GeoBoxes to dc.load(like=...) (#1551)
• Fix broken codecov github action. (#1554)
• Update documentation links to DEA Knowledge Hub (#1559)
• Throw error if time dimension is provided as an int or float to Query construction
  instead of assuming it to be seconds since epoch (#1561)
• Add generic NOT operator and for ODC queries and Not type wrapper (#1563)
• Update whats_new.rst for release (#1568)

Includes contributions from @robbibt, @Ariana-B, @benji-glitsos-ga and @SpacemanPaul

1.9.0 pre-release 2

Second pre-release of the 1.9 branch.

This is not a release candidate and is intended for internal use.

1.9.0 Pre-Release 1

Administrative pre-release to facilitate team cooperation.

Open Data Cube Release 1.8.17

datacube-1.8.17: Maintenance release

• Fix database permission-handling bug affecting datacube system init --no-init-users for the postgres index driver (#1504).
• Switch to new jsonschema "referencing" API, and pin jsonschema>=4.18 (#1477)
• Update whats_new.rst for 1.8.17 release (#1510)

With contributions from @Ariana-B and @SpacemanPaul. Thanks to @omad and @emmaai for identifying the issues.

Open Data Cube release 1.8.16

Maintenance release

Various bug fixes and updates.

Previous releases of the ODC have supported Python 3.8+. With Python 3.8 now at end-of-life, and recent releases of key datacube dependencies (e.g. Xarray and PyProj) already requiring Python 3.9, this release officially drops support for Python 3.8.

Full list of changes:

• Improve error message for mismatch between dataset metadata and product signature #1472
• Mark --confirm-ignore-lineage, --auto-add-lineage, and --verify-lineage as deprecated
  or to be deprecated #1472
• Default delta values in archive_less_mature and find_less_mature #1472
• Fix SQLAlchemy calls and pin jsonschema version to suppress deprecation warnings #1476
• Throw a better error if a dataset is not compatible with archive_less_mature logic #1491
• Fix broken Github action workflow #1496
• Support like=<GeoBox> in virtual product load #1497
• Don't archive less mature if archive_less_mature is provided as False instead of None #1498
• Raise minimum supported Python version to 3.9 #1500
• Manually apply Dependabot updates, and update whats_new.rst for 1.8.16 release #1501

With contributions from @SpacemanPaul @Ariana-B and @uchchwhash

Special thanks to all supporting organisations, especially Geoscience Australia.