You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Introduction of the user-facing Table, Metadata, and File classes
Breaking changes:
The operator save_file became export_file.
The tasks load_file, export_file (previously save_file) and run_raw_sql should be used with use Table, Metadata and File instances
The decorators dataframe, run_raw_sql and transform should be used with Table and Metadata instances.
Temporary removal of the operators aggregate_check, boolean_check, render, and stats_check.
Removal of the class TempTable. It is possible to declare temporary tables using Table(temp=True). All the temporary table names are prefixed with _tmp_. If the user decides to name a Table, it is no longer temporary.
The only mandatory property of a Table instance is conn_id. If the user gives no metadata to Table, the library will try to extract schema and other information from the connection object. If undefined and the database supports schema, the SDK defaults the schema to the value in AIRFLOW__ASTRO__SQL_SCHEMA.
Internals:
Major refactor introducing Database, File, FileType and FileLocation concepts.