Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Optimize Iceberg Pos Delete Building Process #52212

Open
DorianZheng opened this issue Oct 22, 2024 · 0 comments
Open

Optimize Iceberg Pos Delete Building Process #52212

DorianZheng opened this issue Oct 22, 2024 · 0 comments
Assignees
Labels
type/enhancement Make an enhancement to StarRocks

Comments

@DorianZheng
Copy link
Contributor

DorianZheng commented Oct 22, 2024

Enhancement

https://iceberg.apache.org/spec/#position-delete-files

According to the Iceberg spec, rows in the delete file must be sorted by file_path then pos, so that we don't have to read the entire delete file but instead seek the start page which contains the referenced data file path and end as soon as we read different data file path

@DorianZheng DorianZheng added the type/enhancement Make an enhancement to StarRocks label Oct 22, 2024
@DorianZheng DorianZheng self-assigned this Oct 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type/enhancement Make an enhancement to StarRocks
Projects
None yet
Development

No branches or pull requests

1 participant