Skip to content

0.9.0b1

Pre-release
Pre-release
Compare
Choose a tag to compare
@tatiana tatiana released this 24 May 19:30
· 847 commits to main since this release
0.9.0b1
7c4f91d
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

Enhancements:

  • Introduction of the user-facing Table, Metadata, and File classes

Breaking changes:

  • The operator save_file became export_file.
  • The tasks load_file, export_file (previously save_file) and run_raw_sql should be used with use Table, Metadata and File instances
  • The decorators dataframe, run_raw_sql and transform should be used with Table and Metadata instances.
  • Temporary removal of the operators aggregate_check, boolean_check, render, and stats_check.
  • Removal of the class TempTable. It is possible to declare temporary tables using Table(temp=True). All the temporary table names are prefixed with _tmp_. If the user decides to name a Table, it is no longer temporary.
  • The only mandatory property of a Table instance is conn_id. If the user gives no metadata to Table, the library will try to extract schema and other information from the connection object. If undefined and the database supports schema, the SDK defaults the schema to the value in AIRFLOW__ASTRO__SQL_SCHEMA.

Internals:

  • Major refactor introducing Database, File, FileType and FileLocation concepts.
Assets 2
Loading