Skip to content

Commit

Permalink
[pre-commit.ci] pre-commit autoupdate (#2030)
Browse files Browse the repository at this point in the history
<!--pre-commit.ci start-->
updates:
- [github.com/pre-commit/pre-commit-hooks: v4.4.0 →
v4.5.0](pre-commit/pre-commit-hooks@v4.4.0...v4.5.0)
- [github.com/psf/black: 23.7.0 →
23.11.0](psf/black@23.7.0...23.11.0)
- [github.com/astral-sh/ruff-pre-commit: v0.0.287 →
v0.1.6](astral-sh/ruff-pre-commit@v0.0.287...v0.1.6)
- [github.com/codespell-project/codespell: v2.2.5 →
v2.2.6](codespell-project/codespell@v2.2.5...v2.2.6)
- [github.com/pre-commit/mirrors-mypy: v1.5.1 →
v1.7.1](pre-commit/mirrors-mypy@v1.5.1...v1.7.1)
- [github.com/asottile/pyupgrade: v3.10.1 →
v3.15.0](asottile/pyupgrade@v3.10.1...v3.15.0)
<!--pre-commit.ci end-->

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Pankaj <[email protected]>
  • Loading branch information
pre-commit-ci[bot] and pankajastro authored Dec 11, 2023
1 parent fd26225 commit bad6d3a
Show file tree
Hide file tree
Showing 5 changed files with 10 additions and 10 deletions.
12 changes: 6 additions & 6 deletions .pre-commit-config.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@ repos:
- id: check-hooks-apply

- repo: https://github.com/pre-commit/pre-commit-hooks
rev: v4.4.0
rev: v4.5.0
hooks:
- id: check-merge-conflict
- id: check-toml
Expand Down Expand Up @@ -55,7 +55,7 @@ repos:
exclude: ^python-sdk/mk/|^python-sdk/docs/Makefile|^python-sdk/Makefile$|^python-sdk/tests/benchmark/Makefile$

- repo: https://github.com/psf/black
rev: 23.7.0
rev: 23.11.0
hooks:
- id: black
args: ["--config", "./python-sdk/pyproject.toml"]
Expand All @@ -68,30 +68,30 @@ repos:
additional_dependencies: [black>=22.10.0]

- repo: https://github.com/astral-sh/ruff-pre-commit
rev: 'v0.0.287'
rev: 'v0.1.6'
hooks:
- id: ruff
args:
- --config=./ruff.toml

- repo: https://github.com/codespell-project/codespell
rev: v2.2.5
rev: v2.2.6
hooks:
- id: codespell
name: Run codespell to check for common misspellings in files
language: python
types: [text]
exclude: ^mk/.*\.mk$|^python-sdk/docs/Makefile|^python-sdk/Makefile$|^python-sdk/tests/modified_constraint_file.txt$|^python-sdk/tests/benchmark/Makefile$
- repo: https://github.com/pre-commit/mirrors-mypy
rev: 'v1.5.1'
rev: 'v1.7.1'
hooks:
- id: mypy
name: mypy-python-sdk
additional_dependencies: [types-PyYAML, types-attrs, attrs, types-requests, types-python-dateutil]
files: "^python-sdk/"

- repo: https://github.com/asottile/pyupgrade
rev: v3.10.1
rev: v3.15.0
hooks:
- id: pyupgrade
args: [--py37-plus]
Expand Down
2 changes: 1 addition & 1 deletion python-sdk/docs/astro/sql/operators/dataframe.rst
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@
When to use the ``dataframe`` operator
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

The ``dataframe`` operator allows you to run Python transformations in Airflow. Behind the scenes, the ``dataframe`` function automatically coverts the source SQL table into a Pandas dataframe, and makes any dataframes resulting from the transformation available to downstream ``astro.sql`` functions. This means you can seamlessly transition between Python and SQL for data transformations without writing any code to explicitly do so. To use the ``dataframe`` operator, you simply provide a Python function that takes a dataframe as one of its inputs, and specify a ``Table`` object as the input SQL table. If you want the resulting dataframe to be converted back to SQL, you can specify an ``output_table`` object.
The ``dataframe`` operator allows you to run Python transformations in Airflow. Behind the scenes, the ``dataframe`` function automatically converts the source SQL table into a Pandas dataframe, and makes any dataframes resulting from the transformation available to downstream ``astro.sql`` functions. This means you can seamlessly transition between Python and SQL for data transformations without writing any code to explicitly do so. To use the ``dataframe`` operator, you simply provide a Python function that takes a dataframe as one of its inputs, and specify a ``Table`` object as the input SQL table. If you want the resulting dataframe to be converted back to SQL, you can specify an ``output_table`` object.

There are two main uses for the ``dataframe`` operator.

Expand Down
2 changes: 1 addition & 1 deletion python-sdk/example_dags/example_load_file.py
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@
- Install dependencies for Astro Python SDK with Google, refer to README.md
- You can either specify a service account key file and set `GOOGLE_APPLICATION_CREDENTIALS`
with the file path to the service account.
- In the connection we need to specfiy the scopes.
- In the connection we need to specify the scopes.
Connection variable is ``extra__google_cloud_default__scope``
or in Airflow Connections UI ``Scopes (comma separated)``
For ex:- https://www.googleapis.com/auth/drive.readonly
Expand Down
2 changes: 1 addition & 1 deletion python-sdk/src/astro/databases/base.py
Original file line number Diff line number Diff line change
Expand Up @@ -844,7 +844,7 @@ def row_count(self, table: BaseTable):

def parameterize_variable(self, variable: str):
"""
While most databases use sqlalchemy, we want to open up how we paramaterize variables for databases
While most databases use sqlalchemy, we want to open up how we parameterize variables for databases
that a) do not use sqlalchemy and b) have different parameterization schemes (namely delta).
:param variable: The variable to parameterize.
Expand Down
2 changes: 1 addition & 1 deletion python-sdk/src/astro/databases/snowflake.py
Original file line number Diff line number Diff line change
Expand Up @@ -1106,7 +1106,7 @@ def is_valid_snow_identifier(name: str) -> bool:
The following method ensures that a string follows the expected identifier syntax.
.. seealso::
`Snowflake official documentation on indentifiers syntax
`Snowflake official documentation on identifiers syntax
<https://docs.snowflake.com/en/sql-reference/identifiers-syntax.html>`_
"""
Expand Down

0 comments on commit bad6d3a

Please sign in to comment.