Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[META] [Star Tree] [Search] Supported Queries to resolve via star tree #15257

Open
sandeshkr419 opened this issue Aug 15, 2024 · 0 comments
Open
Assignees
Labels
experimental Marks issues as experimental Meta Meta issue, not directly linked to a PR Roadmap:Search Project-wide roadmap label Search:Aggregations Search:Performance v2.18.0 Issues and PRs related to version 2.18.0 v2.19.0 Issues and PRs related to version 2.19.0

Comments

@sandeshkr419
Copy link
Contributor

sandeshkr419 commented Aug 15, 2024

Please describe the end goal of this project

This issue keeps a tracker of supported aggregations & query shapes which can be resolved via star-tree composite indices and the star-tree implementation (if possible) should benefit the performance for the query shape.
This will basically keep a track of supported and planned query shapes which can utilize star-tree aggregation for faster computation.

As for 2.17 release, only numeric fields are supported in star-tree composite indices. The list will be updated as we identify more query shapes that we can pick up.
Community - Please do share/comment on what all you think should be prioritized.

Here is the brief segregation on milestones:

Milestone 1: The primary goal of Milestone 1 is to utilize star-tree to resolve metric aggregation queries (max, min, avg, sum, value count) over numeric fields along with support of a single query as well. This milestone lays out the building blocks of how star-tree approach can be integrated in within a search request to resolve it.

Milestone 2: The primary goal of Milestone 2 is support certain queries within above aggregation requests like term/terms query, boolean query over numeric/keyword fields.

Milestone 3: The primary goal of Milestone 3 is to support single-level bucket aggregations like date histogram, range aggregations, single bucket aggregations, etc

Milestone 4: The goal of this milestone is to extend the star-tree support to resolve nested aggregations, multi-terms aggregations.

Milestone Query Shape Status Target Release Issue PR
1 Metric Aggregation Merged 2.18 #14871 #15289
1 Metric Aggregation with numeric field term query Merged 2.18 #14871 #15289
2 Metric Aggregation with keyword field term query Not Started 2.19 #16537
2 Metric Aggregation with IP field term query Not Started 2.19 #16547
2 Metric Aggregation with multi-terms numeric/keyword query Not Started 2.19 #16538
2 Metric Aggregation with numeric range query Not Started 2.19 #16539
3 Bucket terms Aggregation with metric aggregation Not Started 2.19 #16551
3 Date histogram with metric aggregation Not Started 2.19 #16552
3 Range aggregation with metric aggregation Not Started 2.19 #16553
4 Multi-terms aggregation Not Started (TBD)
4 Nested bucket aggregation Not Started (TBD)

Related component

Search:Aggregations

@sandeshkr419 sandeshkr419 self-assigned this Aug 15, 2024
@github-project-automation github-project-automation bot moved this to Issues and PR's in OpenSearch Roadmap Aug 15, 2024
@getsaurabh02 getsaurabh02 moved this from Todo to In Progress in Performance Roadmap Aug 15, 2024
@getsaurabh02 getsaurabh02 added the Roadmap:Search Project-wide roadmap label label Aug 19, 2024
@mch2 mch2 removed the untriaged label Aug 21, 2024
@getsaurabh02 getsaurabh02 added v2.17.0 v2.18.0 Issues and PRs related to version 2.18.0 labels Sep 9, 2024
@sandeshkr419 sandeshkr419 changed the title [META] Star Tree Supported Queries [META] [Star Tree] [Search] Supported Queries to resolve via star tree Sep 13, 2024
@Pallavi-AWS Pallavi-AWS added the experimental Marks issues as experimental label Oct 7, 2024
@sandeshkr419 sandeshkr419 added v2.19.0 Issues and PRs related to version 2.19.0 and removed v2.17.0 labels Nov 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
experimental Marks issues as experimental Meta Meta issue, not directly linked to a PR Roadmap:Search Project-wide roadmap label Search:Aggregations Search:Performance v2.18.0 Issues and PRs related to version 2.18.0 v2.19.0 Issues and PRs related to version 2.19.0
Projects
Status: New
Status: In Progress
Status: Now(This Quarter)
Development

No branches or pull requests

4 participants