Skip to content

Commit

Permalink
Use pyArrow - Fastparquet not been released yet with fix for
Browse files Browse the repository at this point in the history
```
`np.float_` was removed in the NumPy 2.0 release. Use `np.float64` instead
```
  • Loading branch information
rad-pat committed Sep 26, 2024
1 parent 9412c86 commit c68a901
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion plaidcloud/utilities/frame_manager.py
Original file line number Diff line number Diff line change
Expand Up @@ -2700,7 +2700,7 @@ def avro_to_csv(avro_file_name: str, csv_file_name: str, start_row: int = 0, dat


def parquet_to_csv(parquet_file_name: str, csv_file_name: str, start_row: int = 0, date_format: str = 'YYYY-MM-DD"T"HH:MI:SS'):
df = pd.read_parquet(parquet_file_name, engine='fastparquet')
df = pd.read_parquet(parquet_file_name) # should use pyArrow
if start_row:
df = df.iloc[start_row:]
df.to_csv(
Expand Down

0 comments on commit c68a901

Please sign in to comment.