You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
show create materialized view
| mv_hive_order | CREATE MATERIALIZED VIEW mv_hive_order (dt, product_id, gmv)
PARTITION BY (str2date(dt, '%Y-%m-%d'))
DISTRIBUTED BY HASH(product_id)
REFRESH MANUAL
PROPERTIES (
"replicated_storage" = "true",
"partition_refresh_number" = "1",
"session.enable_spill" = "true",
"replication_num" = "1",
"session.query_timeout" = "3600",
"storage_medium" = "HDD"
)
AS SELECT hive_order.dt, hive_order.product_id, sum(hive_order.price) AS gmv
FROM hive_hms_catalog.ods.hive_order
GROUP BY hive_order.dt, hive_order.product_id;
fix partition ttl lost url : #51194
It was removed when calling the PropertyAnalyzer.analyzePartitionTTL method. Therefore, the properties need to be copied before calling the method and the copied object is used as a parameter. such code :
Map<String, String> props = new HashMap(properties);
Pair<String, PeriodDuration> ttlDuration = PropertyAnalyzer.analyzePartitionTTL(props);
The text was updated successfully, but these errors were encountered:
guanxianchun
changed the title
The problem of materialized view partition ttl property being lost after restarting fe
The materialized view partition ttl property has being lost after restarting fe
Oct 18, 2024
@guanxianchun this is fixed as part of PR #51028 it seems your version does not have the fix.
I am using the latest code from branch 3.1, which already includes the bug fix code. This is a new issue that arose after using the analyzePartitionTTL method.
It was removed when calling the PropertyAnalyzer.analyzePartitionTTL method:
create materialized view
CREATE MATERIALIZED VIEW
mv_hive_order
(dt
,product_id
,gmv
)PARTITION BY (str2date(
dt
, '%Y-%m-%d'))DISTRIBUTED BY HASH(
product_id
)REFRESH MANUAL
PROPERTIES (
"replicated_storage" = "true",
"partition_refresh_number" = "1",
"session.enable_spill" = "true",
"replication_num" = "1",
"session.query_timeout" = "3600",
"partition_ttl" = "2 DAY",
"storage_medium" = "HDD"
)
AS SELECT
hive_order
.dt
,hive_order
.product_id
, sum(hive_order
.price
) ASgmv
FROM
hive_hms_catalog
.ods
.hive_order
restart fe
show create materialized view
| mv_hive_order | CREATE MATERIALIZED VIEW
mv_hive_order
(dt
,product_id
,gmv
)PARTITION BY (str2date(
dt
, '%Y-%m-%d'))DISTRIBUTED BY HASH(
product_id
)REFRESH MANUAL
PROPERTIES (
"replicated_storage" = "true",
"partition_refresh_number" = "1",
"session.enable_spill" = "true",
"replication_num" = "1",
"session.query_timeout" = "3600",
"storage_medium" = "HDD"
)
AS SELECT
hive_order
.dt
,hive_order
.product_id
, sum(hive_order
.price
) ASgmv
FROM
hive_hms_catalog
.ods
.hive_order
GROUP BY
hive_order
.dt
,hive_order
.product_id
;fix partition ttl lost url : #51194
It was removed when calling the PropertyAnalyzer.analyzePartitionTTL method. Therefore, the properties need to be copied before calling the method and the copied object is used as a parameter. such code :
Map<String, String> props = new HashMap(properties);
Pair<String, PeriodDuration> ttlDuration = PropertyAnalyzer.analyzePartitionTTL(props);
The text was updated successfully, but these errors were encountered: