Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[PLUGIN-1803] Add validation for logical type (array/repeated) #1431

Conversation

psainics
Copy link
Contributor

@psainics psainics commented Aug 20, 2024

Add validation for logical type (array/repeated)

Jira : PLUGIN-1803

Description

When we have a BQ field with repeated logical type (say array of dates) current validation only works primitive types, and it fails when BQ.type (=DATE) is compared with the primitive type (INT for Date) causing an invalid mismatch error.

Code change

  • Modified BigQueryUtil.java

Unit Tests

  • Modified BigQueryUtilTest.java
    • testValidateFieldSchemaNotMatchesDate
    • testValidateFieldSchemaMatchesDate

image

@psainics psainics added the build Trigger unit test build label Aug 20, 2024
@psainics psainics force-pushed the patch/array-logical-type-validation branch from 9892d6d to 14d3260 Compare August 28, 2024 08:39
Copy link
Member

@itsankit-google itsankit-google left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please fix e2e test failures in BigQuery.

@psainics psainics merged commit f157898 into data-integrations:develop Aug 30, 2024
16 checks passed
@psainics psainics deleted the patch/array-logical-type-validation branch August 30, 2024 10:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
build Trigger unit test build
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants