In glue Schema, Partition key expects similar Data type for all partitions, to pass set expression in GetPartitions api ? #2417
Unanswered
Sach1nAgarwal
asked this question in
Q&A
Replies: 1 comment 2 replies
-
If let suppose two partitions are there in schema:- Column name | Data Type
GetPartitions fails, if setting expression ( c1 > 20 ) . Now if change data type of c2 to int or bigint or char, get partition passes. |
Beta Was this translation helpful? Give feedback.
2 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
After running the glue crawler, it generates schema, when all partition_key in the generated schema have same data type,
then get_partitions api after set_expression passes,
If any one partition_key have different data type in schema, then after setting set_expression, get_partitions api throwing an error "InvalidInputException"
Is this expected behavior or not?
Beta Was this translation helpful? Give feedback.
All reactions