Skip to content

Latest commit

 

History

History
56 lines (45 loc) · 3.07 KB

ROADMAP.md

File metadata and controls

56 lines (45 loc) · 3.07 KB

OmniSciDB is being intensively developed and is evolving quickly. In order to help the MapD developer community understand our near term priorities, this document shares work targeted for the next 3-6 months. Many of these items are the result of community requests.

We welcome and encourage developer contributions to the project. Please see the contribution guidelines and GitHub issues.

Database

Completed

  • Top k sort on GPU. Ability to efficiently order by a projected column (Completed 3.2.2)
  • JOIN improvements. Additional join types and performance improvements (Completed 3.2)
  • JOIN improvements. Table orderings and optimizations for larger numbers of tables (Ongoing improvements)
  • TRUNCATE. Efficiently remove contents of table or part of table (Completed v3.2)
  • Batched UPDATE and DELETE (Completed 4.0)
  • Interval type, and TIMESTAMP_ADD, TIMESTAMP_DIFF (Completed v3.2)
  • Table Sharding. Table sharding types in addition to the existing round robin (Completed v3.2)
  • Table-level security, GRANT, REVOKE. Ability to grant and revoke table access to users/roles (Testing in 3.2.3, released in 4.0)

Upcoming

  • Use of shared memory to accelerate certain group by operations
  • More efficient memory layout for certain group by operations
  • More efficient range joins
  • Better usage of both GPU and CPU, depending on memory requirements of queries
  • Create table as select (CTAS) improvements (performance, and handling variable length data)
  • Update improvements, including handling variable length data, update via subquery, and more efficient columnar output
  • Delete improvements, including immediate/delayed vacuum capability
  • More granular timestamp support (to nanoseconds)
  • Row-level User Defined Functions (UDFs)

GIS

Completed

  • Basic Geo Types constructed from column coordinates, WKT or geo files (Point, Line, Polygon) (Completed 4.0)
  • Basic Geo functions (ST_Contains, ST_Distance) (Completed 4.0)
  • Feature construction from columnar data ST_MakePoint (Completed 5.0)
  • Additional Geo functions (ST_Within, ST_Area, ST_Perimiter) (Completed 5.0)
  • Geodatabase import (Completed 5.0)

Upcoming

  • Additional OGC mulitpart geospatial types: Multi(Point|Line)
  • Additional geometric constructors (ST_Line, ST_Polygon, etc.)
  • OGC full "simple features" constructive geospatial operators (ST_Buffer, ST_Intersects, ST_Union, etc)
  • Accelerated geospatial joins (with dynamic spatial hashing, not relying purely on brute force loop joins)
  • Fixed length arrays for POINT datatype to conserve memory
  • OGC Geopackage import
  • Additional WMS support
  • Parallel scrolling maps

Data Science/GPU Data Frame (GDF)/Apache Arrow

Completed

Upcoming

  • Increase efficiency of Arrow serialization