Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Revert Fix half up in round #332

Open
wants to merge 79 commits into
base: main
Choose a base branch
from
Open

Revert Fix half up in round #332

wants to merge 79 commits into from

Commits on Jun 26, 2023

  1. Folder: scripts, third_party, website, .github

    main changes:
    1. remove website folder.
    2. add compile script.
    3. fix CmakeList.
    4. clean up github workflow.
    zhejiangxiaomai committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    8555798 View commit details
    Browse the repository at this point in the history
  2. Folder: common, connectors

    main changes:
    1. Support multiple HDFS endpoints.
    2. Add utility method MemoryUsageTracker::highUsage().
    zhejiangxiaomai committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    72f8be5 View commit details
    Browse the repository at this point in the history
  3. Folder: core, duckdb

    main changes:
    1. add expand node.
    2. add kCastIntAllowDecimal.
    zhejiangxiaomai committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    5f51f61 View commit details
    Browse the repository at this point in the history
  4. Folder: dwio

    main changes:
    1. implement vread for input stream.
    2. add caseSensitive in ReaderOptions.
    3. add ORC suuport.
    4. make the DataBuffer grow ratio configurable.
    zhejiangxiaomai committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    e400f3c View commit details
    Browse the repository at this point in the history
  5. Folder: exec

    main changes:
    1. use companion function to support mixed aggregation steps.
    2. add expand operator.
    3. Set partial full when cardinality is high or memory exceeds.
    4. Config option "join_spill_memory_threshold" (kJoinSpillMemoryThreshold) not working.
    5. fix hashjoin runtime issue.
    zhejiangxiaomai committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    9157c8e View commit details
    Browse the repository at this point in the history
  6. Folder: expression

    main changes:
    1. Decimal relative code.
    2. add Add mapping from named_struct to row_constructor.
    zhejiangxiaomai committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    dee1dbc View commit details
    Browse the repository at this point in the history
  7. Folder: functions

    main changes:
    1. Fix half up in round
    2. Clear null for partial avg results.
    3. Support float & double types in pmod function.
    4. Support date/decimal type hash function.
    5. Optimize might contain
    6. Let function validation fail for lookaround pattern in RE2-based implementation.
    7. Register lpad/rpad functions for Spark SQL.
    zhejiangxiaomai committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    9e079b6 View commit details
    Browse the repository at this point in the history
  8. Folder: row

    main changes:
    
    1. Decimal relative.
    zhejiangxiaomai committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    a23ce36 View commit details
    Browse the repository at this point in the history
  9. Folder: substrait

    main changes:
    
    1.	Support Decimal (type parse/function mapping/getPrecisionAndScale)
    2.	Support JoinRel and choose Merge join or Hash join by advanced_extension.
    3.	Support reading partition columns.
    4.	Support selecting a subfield from struct.
    5.	Support kstruct/kBinary/kDecimal literal.
    6.	Support switch/ kSingularOrList expression.
    7.	Support ExpandRel/WindowRel.
    8.	Filter pushdown.
    9.	SubstraitToVeloxPlanValidator.
    zhejiangxiaomai committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    f84f646 View commit details
    Browse the repository at this point in the history
  10. Folder: type

    main changes:
    
    1. Decimal relative.
    2. Use a config to control the tokenizing of dot.
    3. Use companion function to support mixed aggregation steps
    zhejiangxiaomai committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    38c60fc View commit details
    Browse the repository at this point in the history
  11. Folder: vector

    main changes:
    
    1. Make varchar and varbinary compatible.
    2. Add ValueStreamNode operator
    zhejiangxiaomai committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    01734cc View commit details
    Browse the repository at this point in the history
  12. Add back not node (oap-project#228)

    * Add back not node.
    
    * Fix NOT handling in metadata filter.
    
    ---------
    
    Co-authored-by: Jimmy Lu <[email protected]>
    2 people authored and zhejiangxiaomai committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    45fe7ae View commit details
    Browse the repository at this point in the history
  13. enable all tests (oap-project#247)

    rui-mo authored and zhejiangxiaomai committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    c15ae53 View commit details
    Browse the repository at this point in the history
  14. Configuration menu
    Copy the full SHA
    eeca6b4 View commit details
    Browse the repository at this point in the history
  15. Update build dependencies (oap-project#185)

    Updated dependencies:
    
    libhdfs3: Try find_package first
    gflags: Allow static library
    xsimd, gtest: Allow finding from system
    Arrow, Parquet: Prefer external build if -D<package>_DIR=/path/to/arrow/install is defined
    flex 2.5.13 -> 2.6.0 (2.6.0 removed register keyword)
    Compat boost >= 1.79
    ccat3z authored and zhejiangxiaomai committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    3b719f2 View commit details
    Browse the repository at this point in the history
  16. Configuration menu
    Copy the full SHA
    6f586e7 View commit details
    Browse the repository at this point in the history
  17. Configuration menu
    Copy the full SHA
    917c9b5 View commit details
    Browse the repository at this point in the history
  18. Avoid include Abi.h twice (oap-project#253)

    velox cpp file use "velox/vector/arrow/Abi.h" 
    velox header file use external arrow/Abi.h
    zhejiangxiaomai committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    4477859 View commit details
    Browse the repository at this point in the history
  19. add decimal column reader support (oap-project#254)

    add decimal column reader support.
    ---------
    
    Co-authored-by: zuochunwei <[email protected]>
    Co-authored-by: zhejiangxiaomai <[email protected]>
    3 people committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    89a1e9d View commit details
    Browse the repository at this point in the history
  20. Support timestamp reader (oap-project#205)

    Add a drafted timestamp reader. Support timestamp in substrait, and add some validations for unsupported cases.
    rui-mo authored and zhejiangxiaomai committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    77f776d View commit details
    Browse the repository at this point in the history
  21. Fix the intermediate type of First/Last, and support decimal (oap-pro…

    …ject#245)
    
    Align First/Last aggregate function's intermediate result with Spark. Support decimal.
    Yohahaha authored and zhejiangxiaomai committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    0c94165 View commit details
    Browse the repository at this point in the history
  22. Configuration menu
    Copy the full SHA
    35c82ab View commit details
    Browse the repository at this point in the history
  23. Added RleEncoderV2 (oap-project#240)

    Co-authored-by: yangyimin <[email protected]>
    2 people authored and zhejiangxiaomai committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    bf9854d View commit details
    Browse the repository at this point in the history
  24. [GLUTEN-1434] Serialize and deserialize RowVector (oap-project#250)

    Support serialize and deserialize RowVector.
    jinchengchenghh authored and zhejiangxiaomai committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    c1cdb08 View commit details
    Browse the repository at this point in the history
  25. Expand timestamps in page reader (oap-project#260)

    xpand timestamps in page reader so getValues of SelectiveIntegerColumnReader can be reused.
    rui-mo authored and zhejiangxiaomai committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    9049f02 View commit details
    Browse the repository at this point in the history
  26. Configuration menu
    Copy the full SHA
    c814d78 View commit details
    Browse the repository at this point in the history
  27. Fix the array out of bounds while getting offsets (oap-project#257)

    * fix segmentation fault in createStringFlatVector
    jackylee-ch authored and zhejiangxiaomai committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    ce59310 View commit details
    Browse the repository at this point in the history
  28. whitelist approx_distinct (oap-project#270)

    Co-authored-by: zhli1142015 <[email protected]>
    2 people authored and zhejiangxiaomai committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    b50fac1 View commit details
    Browse the repository at this point in the history
  29. Configuration menu
    Copy the full SHA
    2cef858 View commit details
    Browse the repository at this point in the history
  30. Add long decimal type support for ORC (oap-project#271)

    Further improved SelectiveLongDecimalColumnReader. Added decoder for int128_t.
    
    ---------
    
    Co-authored-by: yangyimin <[email protected]>
    2 people authored and zhejiangxiaomai committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    55bfb67 View commit details
    Browse the repository at this point in the history
  31. Configuration menu
    Copy the full SHA
    d5e7140 View commit details
    Browse the repository at this point in the history
  32. Configuration menu
    Copy the full SHA
    4585f28 View commit details
    Browse the repository at this point in the history
  33. Configuration menu
    Copy the full SHA
    c0ac859 View commit details
    Browse the repository at this point in the history
  34. Configuration menu
    Copy the full SHA
    49580f1 View commit details
    Browse the repository at this point in the history
  35. Configuration menu
    Copy the full SHA
    2f9c7e2 View commit details
    Browse the repository at this point in the history
  36. Configuration menu
    Copy the full SHA
    1e87424 View commit details
    Browse the repository at this point in the history
  37. Configuration menu
    Copy the full SHA
    3a2a8b0 View commit details
    Browse the repository at this point in the history
  38. Configuration menu
    Copy the full SHA
    e1e34fa View commit details
    Browse the repository at this point in the history
  39. Configuration menu
    Copy the full SHA
    866fef0 View commit details
    Browse the repository at this point in the history
  40. Configuration menu
    Copy the full SHA
    ab82edd View commit details
    Browse the repository at this point in the history
  41. Configuration menu
    Copy the full SHA
    d22ca23 View commit details
    Browse the repository at this point in the history
  42. Configuration menu
    Copy the full SHA
    b2fcaeb View commit details
    Browse the repository at this point in the history
  43. Configuration menu
    Copy the full SHA
    86c12a2 View commit details
    Browse the repository at this point in the history
  44. Configuration menu
    Copy the full SHA
    1f4997d View commit details
    Browse the repository at this point in the history
  45. remove log (oap-project#286)

    Yohahaha authored and zhejiangxiaomai committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    14fa3a4 View commit details
    Browse the repository at this point in the history
  46. Support kPreceeding & kFollowing for window range frame type (oap-pro…

    …ject#287)
    
    * Initial commit
    
    * Fix compile issue
    
    * Cherry pick PR 4510
    
    * Fix issue in upstream PR
    
    * Fix bugs for unique sort key
    
    * Fix bugs for repeated sort key
    
    * Add more test cases
    
    * Fix int type issue
    
    * Handle null
    
    * Remove some commented code
    
    * Remove check null
    
    * Fix velox ut failure for rows frame
    
    * Format the code
    PHILO-HE authored and zhejiangxiaomai committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    7921c88 View commit details
    Browse the repository at this point in the history
  47. Configuration menu
    Copy the full SHA
    c93c68e View commit details
    Browse the repository at this point in the history
  48. Configuration menu
    Copy the full SHA
    6e17f84 View commit details
    Browse the repository at this point in the history
  49. Configuration menu
    Copy the full SHA
    c5987a9 View commit details
    Browse the repository at this point in the history
  50. Configuration menu
    Copy the full SHA
    56bd304 View commit details
    Browse the repository at this point in the history
  51. Fix use pre-build arrow (oap-project#289)

    In Ubuntu, thrift will be installed manually in setup scripts, but Arrow still compile thrift, then Velox use system thrift and pre-build arrow/parquet.
    In Centos, Velox could not found system thrift, so it will compile Arrow and thrift twice.
    Since Arrow will compile thrift in all environments, lets use these pre-build shared libs to save time and keep toolchain consistency.
    
    Support native dependency could be overrided by env variables.
    Yohahaha authored and zhejiangxiaomai committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    c003ecf View commit details
    Browse the repository at this point in the history
  52. Configuration menu
    Copy the full SHA
    167d46c View commit details
    Browse the repository at this point in the history
  53. Configuration menu
    Copy the full SHA
    13c10c9 View commit details
    Browse the repository at this point in the history
  54. [DWIO] refactor the reader of dwrf/orc (oap-project#261)

    Co-authored-by: zuochunwei <[email protected]>
    2 people authored and zhejiangxiaomai committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    6e9a50d View commit details
    Browse the repository at this point in the history
  55. Configuration menu
    Copy the full SHA
    56dab28 View commit details
    Browse the repository at this point in the history
  56. Configuration menu
    Copy the full SHA
    f21d905 View commit details
    Browse the repository at this point in the history
  57. update dnf cache on centos (oap-project#302)

    Signed-off-by: Yuan Zhou <[email protected]>
    zhouyuan authored and zhejiangxiaomai committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    30ffabd View commit details
    Browse the repository at this point in the history
  58. Support selecting a subfield from struct (oap-project#294)

    Co-authored-by: zhejiangxiaomai <[email protected]>
    rui-mo and zhejiangxiaomai committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    3819ace View commit details
    Browse the repository at this point in the history
  59. Configuration menu
    Copy the full SHA
    6727295 View commit details
    Browse the repository at this point in the history
  60. Configuration menu
    Copy the full SHA
    dcc8d89 View commit details
    Browse the repository at this point in the history
  61. [ORC] Add max/min support for ORC decimal reader (oap-project#301)

    Co-authored-by: zuochunwei <[email protected]>
    2 people authored and zhejiangxiaomai committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    bf00cd6 View commit details
    Browse the repository at this point in the history
  62. Configuration menu
    Copy the full SHA
    491cd19 View commit details
    Browse the repository at this point in the history
  63. Configuration menu
    Copy the full SHA
    f1fa225 View commit details
    Browse the repository at this point in the history
  64. Configuration menu
    Copy the full SHA
    0260d44 View commit details
    Browse the repository at this point in the history
  65. Configuration menu
    Copy the full SHA
    f842ca1 View commit details
    Browse the repository at this point in the history
  66. Configuration menu
    Copy the full SHA
    a923a8c View commit details
    Browse the repository at this point in the history
  67. Configuration menu
    Copy the full SHA
    b03fa9c View commit details
    Browse the repository at this point in the history
  68. ld (oap-project#317)

    Co-authored-by: zuochunwei <[email protected]>
    2 people authored and zhejiangxiaomai committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    bb6a570 View commit details
    Browse the repository at this point in the history
  69. Configuration menu
    Copy the full SHA
    138ea18 View commit details
    Browse the repository at this point in the history
  70. Configuration menu
    Copy the full SHA
    c9d1b5f View commit details
    Browse the repository at this point in the history
  71. Configuration menu
    Copy the full SHA
    a3ab04b View commit details
    Browse the repository at this point in the history
  72. Add flag for sort in window (oap-project#321)

    * add flag for sort in window op
    
    * minor change
    zhli1142015 authored and zhejiangxiaomai committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    4884996 View commit details
    Browse the repository at this point in the history
  73. Configuration menu
    Copy the full SHA
    e09cc23 View commit details
    Browse the repository at this point in the history
  74. Fix too much small row group issue in Velox parquet writer (oap-proje…

    …ct#326)
    
    Co-authored-by: youxiduo <[email protected]>
    2 people authored and zhejiangxiaomai committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    03fa725 View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2023

  1. rebase to velox 4.27 300370f

    ‘zhaozhenhui’ authored and zhejiangxiaomai committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    e9a9ea4 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    a82efbb View commit details
    Browse the repository at this point in the history

Commits on Jun 28, 2023

  1. Configuration menu
    Copy the full SHA
    18a3512 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    bb35ed6 View commit details
    Browse the repository at this point in the history
  3. revert Fix half up in round

    JkSelf committed Jun 28, 2023
    Configuration menu
    Copy the full SHA
    e3ea169 View commit details
    Browse the repository at this point in the history