Release 0.7.3

Co-authored-by: Michał Bartoszkiewicz <[email protected]> Co-authored-by: Jan Chorowski <[email protected]> Co-authored-by: Xavier Gendre <[email protected]> Co-authored-by: Adrian Kosowski <[email protected]> Co-authored-by: Jakub Kowalski <[email protected]> Co-authored-by: Sergey Kulik <[email protected]> Co-authored-by: Mateusz Lewandowski <[email protected]> Co-authored-by: Mohamed Malhou <[email protected]> Co-authored-by: Krzysztof Nowicki <[email protected]> Co-authored-by: Richard Pelgrim <[email protected]> Co-authored-by: Kamil Piechowiak <[email protected]> Co-authored-by: Paweł Podhajski <[email protected]> Co-authored-by: Olivier Ruas <[email protected]> Co-authored-by: Przemysław Uznański <[email protected]> Co-authored-by: Sebastian Włudzik <[email protected]> GitOrigin-RevId: 52eb53335aafe2bc78d71c58089a9a8813ee51aa
pathwaycom · Nov 30, 2023 · 94ef24c · 94ef24c
1 parent 131b76a
commit 94ef24c
Show file tree

Hide file tree

Showing 65 changed files with 2,516 additions and 720 deletions.
diff --git a/CHANGELOG.md b/CHANGELOG.md
@@ -5,6 +5,24 @@ All notable changes to this project will be documented in this file.
 This project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
 ## [Unreleased]
 
+## [0.7.3] - 2023-11-30
+
+### Added
+- A method `weekday` has been added to the `dt` namespace, that can be called on column expressions containing datetime data. This method returns an integer that represents the day of the week.
+- **EXPERIMENTAL**: Methods `show` and `plot` on Tables, providing visualizations of data using HoloViz Panel.
+- Added support for `instance` parameter to `groupby`, `join`, `windowby` and temporal join methods.
+- `pw.PersistenceMode.UDF_CACHING` persistence mode enabling automatic caching of `AsyncTransformer` invocations.
+
+### Changed
+- Methods `round` and `floor` on columns with datetimes now accept duration argument to be a string.
+- `pw.debug.compute_and_print` and `pw.debug.compute_and_print_update_stream` have a new argument `n_rows` that limits the number of rows printed.
+- `pw.debug.table_to_pandas` has a new argument `include_id` (by default `True`). If set to `False`, creates a new index for the Pandas DataFrame, rather than using the keys of the Pathway Table.
+- `windowby` function `shard` argument is now deprecated and `instance` should be used.
+- Special column name `_pw_shard` is now deprecated, and `_pw_instance` should be used.
+- `pw.ReplayMode` now can be accessed as `pw.PersistenceMode`, while the `SPEEDRUN` and `REALTIME` variants are now accessible as `SPEEDRUN_REPLAY` and `REALTIME_REPLAY`.
+- **EXPERIMENTAL**: `pw.io.gdrive.read` has a new argument `with_metadata` (by default `False`). If set to `True`, adds a `_metadata` column containing file metadata to the resulting table.
+- Methods `get_nearest_items` and `get_nearest_items_asof_now` of `KNNIndex` allow to specify `k` (number of returned elements) separately in each query.
+
 ## [0.7.2] - 2023-11-24
 
 ### Added

diff --git a/Cargo.lock b/Cargo.lock
diff --git a/Cargo.toml b/Cargo.toml
@@ -1,6 +1,6 @@
 [package]
 name = "pathway"
-version = "0.7.2"
+version = "0.7.3"
 edition = "2021"
 publish = false
 rust-version = "1.72.0"
@@ -39,22 +39,22 @@ log = { version = "0.4.20", features = ["std"] }
 ndarray = { version = "0.15.6", features = ["serde"] }
 nix = { version = "0.27.1", features = ["fs", "user"] }
 num-integer = "0.1.45"
-numpy = "0.19.0"
+numpy = "0.20.0"
 once_cell = "1.18.0"
 ordered-float = { version = "4.1.1", features = ["serde"] }
 pipe = "0.4.0"
 postgres = { version = "0.19.7", features = ["with-chrono-0_4", "with-serde_json-1"] }
 prometheus-client = "0.22.0"
-pyo3 = { version = "0.19.2", features = ["abi3-py310", "multiple-pymethods"] }
-pyo3-asyncio = "0.19.0"
+pyo3 = { version = "0.20.0", features = ["abi3-py310", "multiple-pymethods"] }
+pyo3-asyncio = "0.20.0"
 pyo3-log = "0.9.0"
 rand = "0.8.5"
 rdkafka = { version = "0.36.0", features = ["ssl-vendored", "cmake-build", "zstd"] }
 rusqlite = { version = "0.30.0", features = ["bundled"] }
 rust-s3 = { version = "0.33.0", features = ["sync-native-tls-vendored", "sync-native-tls", "fail-on-err"], default-features = false }
 scopeguard = "1.2.0"
 send_wrapper = "0.6.0"
-serde = { version = "1.0.192", features = ["derive", "rc"] }
+serde = { version = "1.0.193", features = ["derive", "rc"] }
 serde_json = "1.0"
 serde_with = "3.4.0"
 smallvec = { version = "1.11.2", features = ["union", "const_generics"] }
@@ -86,4 +86,4 @@ inherits = "release"
 debug = true
 
 [build-dependencies]
-pyo3-build-config = "0.19.2"
+pyo3-build-config = "0.20.0"
diff --git a/README.md b/README.md
@@ -35,7 +35,7 @@
 
 [Pathway](https://pathway.com) is an open framework for high-throughput and low-latency real-time data processing. It is used to create Python code which seamlessly combines batch processing, streaming, and real-time API's for LLM apps. Pathway's distributed runtime (🦀-🐍) provides fresh results of your data pipelines whenever new inputs and requests are received.
 
-![Screencast animation of converting batch code to streaming by changing one keyword argument in the script.](https://github.com/pathwaycom/pathway/assets/68642378/79f4250d-0641-4b97-87f8-0820d9399c6b)
+![Pathway is an incremental data stream processing engine](https://github.com/pathwaycom/IoT-Pathway/assets/28102878/084593de-9325-4eee-b84a-06b8666efcd1)
 
 Pathway provides a high-level programming interface in Python for defining data transformations, aggregations, and other operations on data streams.
 With Pathway, you can effortlessly design and deploy sophisticated data workflows that efficiently handle high volumes of data in real time.
@@ -48,6 +48,8 @@ In Pathway, data is represented in the form of Tables. Live data streams are als
 
 For any questions, you will find the community and team behind the project [on Discord](https://discord.com/invite/pathway).
 
+![Screencast animation of converting batch code to streaming by changing one keyword argument in the script.](https://github.com/pathwaycom/pathway/assets/68642378/79f4250d-0641-4b97-87f8-0820d9399c6b)
+
 ## Getting started<a id="getting-started"></a>
 
 
@@ -236,4 +238,4 @@ If you have any questions, issues, or just want to chat about Pathway, we're her
 - Reach out to us via email at [[email protected]](mailto:[email protected]).
 
  Our team is always happy to help you and ensure that you get the most out of Pathway.
-If you would like to better understand how best to use Pathway in your project, please don't hesitate to reach out to us.
+If you would like to better understand how best to use Pathway in your project, please don't hesitate to reach out to us.
diff --git a/pyproject.toml b/pyproject.toml
@@ -33,6 +33,8 @@ dependencies = [
     "boto3 >= 1.26.76",
     "google-api-python-client >= 2.108.0",
     "typing_extensions >= 4.8.0",
+    "panel >= 1.3.1",
+    "jupyter_bokeh >= 3.0.7",
 ]
 
 [project.optional-dependencies]