-
Notifications
You must be signed in to change notification settings - Fork 0
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Move dependencies to devDependencies #3
Conversation
…ed for tests). Work in progress, parquet.ts needs work
@@ -72,6 +72,7 @@ ParquetSchema { | |||
"compression": "GZIP", | |||
"dLevelMax": 0, | |||
"encoding": "PLAIN", | |||
"logicalType": undefined, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The latest version of Parquetjs also has this field
|
||
const [parquetSchema, writerOptions] = parquet.fromDSNPSchema(descriptorForAnnouncementType(AnnouncementType.Broadcast).parquetSchema); | ||
const writer = await ParquetWriter.openFile(parquetSchema, "./file.parquet", writerOptions); | ||
const writer = await ParquetWriter.openFile(new ParquetSchema(parquetSchema), "./file.parquet", writerOptions); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This is the change we should highlight in the changelog. Effectively instead of constructing this class object in here, we require devs to do it outside. Not a bad tradeoff for dropping the dependency.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Approved, but I wrote some of it.
Don't bring in avsc or @dsnp/parquetjs as core dependencies (still used for tests).
Work in progress, parquet.ts needs work