Skip to content

Version 0.5.0

Latest
Latest
Compare
Choose a tag to compare
@seankao-az seankao-az released this 30 Sep 21:31
· 6 commits to 0.5 since this release
v0.5.0
280bd92
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

What's Changed

  • Fix incorrect result in show index statement by @dai-chen in #332
  • Bump Flint version to 0.5.0 by @dai-chen in #343
  • Enhance index monitor to terminate streaming job on consecutive errors by @dai-chen in #346
  • Updating security reachout email by @varun-lodaya in #340
  • Transition Flint index state to Failed upon refresh job termination by @dai-chen in #362
  • Pre-validate duplicate columns in materialized view query by @dai-chen in #359
  • Fix index state stuck in refreshing when streaming job exits early by @dai-chen in #370
  • Read dataSourceName from FlintOptions and avoid passing as args by @seankao-az in #378
  • Refactor static method for OpenSearch client utils by @seankao-az in #377
  • [Refactor] Introduce flint-commons for models and interfaces by @noCharger in #373
  • Extract metadata log operations from FlintClient into FlintMetadataLogService by @seankao-az in #379
  • Support nested indexed field in Flint skipping index SQL statement by @dai-chen in #366
  • Support custom metadata log service implementation by @seankao-az in #389
  • Abstracting source relations for enhanced covering index rewriting by @dai-chen in #391
  • Add OpenSearchCatalog to enable direct access OpenSearch index in Spark SQL by @penghuo in #399
  • Enhance Flint Spark API error reporting with centralized handler by @dai-chen in #348
  • Unquote text and identifiers in PPL parsing by @seankao-az in #393
  • handle MetaException with glue AccessDeniedException by @noCharger in #410
  • support shard level split on read path by @penghuo in #402
  • Pre-validate checkpoint location write permission by @dai-chen in #414
  • Separate metadata log entry data model and persistence by @seankao-az in #406
  • Add scheduler_mode index option by @noCharger in #415
  • Enhance query rewriter rule to support partial covering index by @dai-chen in #409
  • Store error message for streaming job execution in Flint metadata log by @dai-chen in #433
  • Add create Pit api and fix sigv4 bug by @penghuo in #434
  • Support custom extension conf by @noCharger in #438
  • Revert OpenSearch Version to 2.6 by @penghuo in #444
  • Remove unimplemented syntax by @ykmr1224 in #439
  • Update README to reflect available commands by @ykmr1224 in #447
  • Add FlintJob integration test with EMR serverless by @penghuo in #449
  • [Bugfix] Insights on query execution error by @noCharger in #475
  • Disable unsupported PPL function expressions by @ykmr1224 in #478
  • Add error output column to show Flint index statement by @dai-chen in #436
  • [Doc] Checklist to fix issue "could not find Docker environment" on macOS by @LantaoJin in #477
  • Translate PPL-builtin functions to Spark-builtin functions by @LantaoJin in #448
  • Translate Eval Command by @LantaoJin in #499
  • Fix SigV4 signature when connecting to OpenSearchServerless by @ykmr1224 in #473
  • Support more PPL builtin functions by adding a name mapping by @LantaoJin in #504
  • Add OpenSearchTable in flint core by @penghuo in #479
  • Reorganize IT directory to prevent unintentional execution from UT by @dai-chen in #501
  • Add config on query loop execution frequency by @noCharger in #411
  • Use refresh policy from config by @ykmr1224 in #530
  • Add PPL describe command by @YANG-DB in #541
  • Terminate streaming job when index data is deleted by @dai-chen in #500
  • Upgrade Spark 3.5.1 by @penghuo in #525
  • [Backport 0.5] Add statement timeout by @opensearch-trigger-bot in #550
  • [Backport 0.5] Remove query rewrite for LogsTable skipping index by @opensearch-trigger-bot in #553
  • [Backport 0.5] Fix refresh policy back to WAIT_FOR other than writing query result by @opensearch-trigger-bot in #557
  • [Backport 0.5] Lateral eval expressions are supported after Spark upgrading by @opensearch-trigger-bot in #561
  • [Backport 0.5] Translate PPL dedup Command Part 1: allowedDuplication=1 by @opensearch-trigger-bot in #566
  • [Backport 0.5] Add rate limiter for bulk request by @opensearch-trigger-bot in #571
  • [Backport 0.5] Abstract service for accessing Flint index metadata by @opensearch-trigger-bot in #575
  • [Backport 0.5] Update PPL describe command by @opensearch-trigger-bot in #578
  • [Backport 0.5] Implement stddev_samp and stddev_pop ppl stats function by @opensearch-trigger-bot in #581
  • [Backport 0.5] Top & Rare PPL commands support by @opensearch-trigger-bot in #583
  • [Backport 0.5] Nested fields query fix by @opensearch-trigger-bot in #585
  • [Backport 0.5] Add percentile PPL function by @opensearch-trigger-bot in #587
  • [Backport 0.5] Add conf for specifying flint checkpoint location by @opensearch-trigger-bot in #589
  • [Backport 0.5] Fix distinct_count ppl stats function by @opensearch-trigger-bot in #590
  • [Backport 0.5] PPL Parse command by @opensearch-trigger-bot in #597
  • [Backport 0.5] Add support of GroK command including default patterns by @opensearch-trigger-bot in #610
  • [Backport 0.5] Translate PPL dedup Command Part 2: allowedDuplication>1 by @opensearch-trigger-bot in #615
  • [Backport 0.5] Add UT and IT for 2+ level aggregations PPL command by @opensearch-trigger-bot in #613
  • [Backport 0.5] Remove checkpoint folder when vacuuming index by @opensearch-trigger-bot in #629
  • [Backport 0.5] [Refactor] Extend REPL to support external metadata storage and data storage by @opensearch-trigger-bot in #604
  • [Backport 0.5] Update checkpoint location on alter path by @opensearch-trigger-bot in #631
  • [Backport 0.5] Refactor FlintJob with FlintStatement and StatementExecutionManager by @opensearch-trigger-bot in #636
  • [Backport 0.5] Ppl patterns command by @opensearch-trigger-bot in #639
  • [Backport 0.5] Disable timeout params for deleteIndex API only for serverless by @opensearch-trigger-bot in #649
  • [Backport 0.5] Add langType to FlintStatement model by @opensearch-trigger-bot in #665
  • [Backport 0.5] Fix ppl describe bug #612 by @opensearch-trigger-bot in #659
  • [Backport 0.5] ispresent implemented as function by @opensearch-trigger-bot in #653
  • [Backport 0.5] Add support for serializing TimestampNTZType by @opensearch-trigger-bot in #684
  • [Backport 0.5] Optional support for getAllIndexMetadata by index pattern by @opensearch-trigger-bot in #690
  • [Manual Backport 0.5] Introduce async query scheduler (#668) by @noCharger in #691
  • [Backport 0.5] Add resultIndex to session manager extension by @opensearch-trigger-bot in #692
  • [Backport 0.5] [REFACTOR] Move DF reformat from StatementExecutionManagerImpl to QueryResultWriterImpl by @opensearch-trigger-bot in #715
  • [Backport 0.5] Support Fields Minus Command by @opensearch-trigger-bot in #725
  • [Backport 0.5] Re-select an excluded field should throw SyntaxCheckException by @LantaoJin in #728
  • [Backport 0.5] Support table identifier contains dot with backticks by @YANG-DB in #773
  • [Backport 0.5] Support recovery for index with external scheduler by @opensearch-trigger-bot in #776
  • [Backport 0.5] Add auth-crt lib as runtime dependency by @opensearch-trigger-bot in #779

New Contributors

Full Changelog: v0.4.1...v0.5.0

Contributors

LantaoJin, penghuo, and 6 other contributors
Assets 2
Loading