Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

chore: add docker-compose #113

Open
wants to merge 186 commits into
base: main
Choose a base branch
from
Open

chore: add docker-compose #113

wants to merge 186 commits into from

Commits on Jul 10, 2024

  1. chore: language update for install from source.

    @billy-the-fish
    billy-the-fish committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    29eeccc View commit details
    Browse the repository at this point in the history

  2. Excellent :-). 

    Co-authored-by: John Pruitt <[email protected]>
Signed-off-by: Iain Cox <[email protected]>
    @billy-the-fish @jgpruitt
    billy-the-fish and jgpruitt authored Jul 10, 2024
    Configuration menu
    Copy the full SHA
    e354514 View commit details
    Browse the repository at this point in the history

  3. Merge pull request #46 from timescale/language-review 

    chore: language update for install from source.
    @billy-the-fish
    billy-the-fish authored Jul 10, 2024
    Configuration menu
    Copy the full SHA
    9965e16 View commit details
    Browse the repository at this point in the history

Commits on Jul 11, 2024

  1. Update README.md 

    Fixed error in how we describe models available via pgai

Signed-off-by: Avthar Sewrathan <[email protected]>
    @avthars
    avthars authored Jul 11, 2024
    Configuration menu
    Copy the full SHA
    73fdae4 View commit details
    Browse the repository at this point in the history

Commits on Jul 22, 2024

  1. Move asdf plpython3u instructions to plpython3u section

    @alejandrodnm
    alejandrodnm committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    a3e2b35 View commit details
    Browse the repository at this point in the history

Commits on Jul 23, 2024

  1. Merge pull request #48 from timescale/adn/readme-fix 

    Move asdf plpython3u instructions to plpython3u section
    @alejandrodnm
    alejandrodnm authored Jul 23, 2024
    Configuration menu
    Copy the full SHA
    237499e View commit details
    Browse the repository at this point in the history

Commits on Jul 25, 2024

  1. Adapt build/install to deal with versioning 

    * "Internal" Python code is now supported
* New versions do not install Python dependencies
  system-wide
* Each version's Python code and dependencies are
  installed to separate target locations
* The path to the Python libs can be overridden
  via postgres.conf
* SQL source code is either idempotent or
  incremental
* Create extension-owned ai schema
* Add migration table to manage incremental SQL
* Revised make to facilitate all of the above
* Lint sql with pgspot
    @jgpruitt
    jgpruitt committed Jul 25, 2024
    Configuration menu
    Copy the full SHA
    de1bc62 View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2024

  1. Add linter and format checks

    @jgpruitt
    jgpruitt committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    6fc188d View commit details
    Browse the repository at this point in the history

Commits on Jul 30, 2024

  1. Fixed silly logic bug

    @jgpruitt
    jgpruitt committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    94b1b82 View commit details
    Browse the repository at this point in the history

Commits on Aug 2, 2024

  1. Add space in README 

    Signed-off-by: Mike Freedman <[email protected]>
    @mfreed
    mfreed authored Aug 2, 2024
    Configuration menu
    Copy the full SHA
    007d9cf View commit details
    Browse the repository at this point in the history

  2. Fix typo referencing OpenAI instead of Ollama 

    Signed-off-by: Mike Freedman <[email protected]>
    @mfreed
    mfreed authored Aug 2, 2024
    Configuration menu
    Copy the full SHA
    2c68539 View commit details
    Browse the repository at this point in the history

  3. Merge pull request #57 from timescale/mfreed-patch-1 

    Add space in README
    @mfreed
    mfreed authored Aug 2, 2024
    Configuration menu
    Copy the full SHA
    b6e1a53 View commit details
    Browse the repository at this point in the history

  4. Merge pull request #58 from timescale/mfreed-patch-2 

    Fix typo referencing OpenAI instead of Ollama
    @mfreed
    mfreed authored Aug 2, 2024
    Configuration menu
    Copy the full SHA
    c47a4e0 View commit details
    Browse the repository at this point in the history

Commits on Aug 5, 2024

  1. Add support for rank_fields parameter to cohere_rerank

    @jgpruitt
    jgpruitt committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    ea947b5 View commit details
    Browse the repository at this point in the history

  2. Add support for base_url param to openai

    @jgpruitt
    jgpruitt committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    ce1b6d4 View commit details
    Browse the repository at this point in the history

Commits on Aug 6, 2024

  1. Modify func volatility for performance

    @jgpruitt
    jgpruitt committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    a470e4a View commit details
    Browse the repository at this point in the history

Commits on Aug 7, 2024

  1. Convert ollama tests to pytest

    @jgpruitt
    jgpruitt committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    ee7efea View commit details
    Browse the repository at this point in the history

  2. Convert anthropic tests to pytest

    @jgpruitt
    jgpruitt committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    80af00b View commit details
    Browse the repository at this point in the history

  3. Convert openai tests to pytest

    @jgpruitt
    jgpruitt committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    564acf4 View commit details
    Browse the repository at this point in the history

  4. Convert cohere tests to pytest

    @jgpruitt
    jgpruitt committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    fd8a908 View commit details
    Browse the repository at this point in the history

  5. Remove old tests

    @jgpruitt
    jgpruitt committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    f00b047 View commit details
    Browse the repository at this point in the history

  6. Update DEVELOPMENT doc

    @jgpruitt
    jgpruitt committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    1f7fe5a View commit details
    Browse the repository at this point in the history

Commits on Aug 12, 2024

  1. docs: update README.md 

    environement -> environment

Signed-off-by: Ikko Eltociear Ashimine <[email protected]>
    @eltociear @jgpruitt
    eltociear authored and jgpruitt committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    2d5059f View commit details
    Browse the repository at this point in the history

Commits on Sep 11, 2024

  1. 1. create new branch rag_demo_v1 , add verified file and merged to ma… 

    …in from local

2. merge to main branch
    @Wang-Yong2018 @jgpruitt
    Wang-Yong2018 authored and jgpruitt committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    20c3853 View commit details
    Browse the repository at this point in the history

  2. change the demo sql from doc folder to example folder.

    @Wang-Yong2018 @jgpruitt
    Wang-Yong2018 authored and jgpruitt committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    2458010 View commit details
    Browse the repository at this point in the history

  3. add blog url on top of the rag_report_demo_why_some_customer_donot_li… 

    …ke_pizza.sql

rm doc/rag_demo_*
rm docs/pgai_rag*
    @Wang-Yong2018 @jgpruitt
    Wang-Yong2018 authored and jgpruitt committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    8edee29 View commit details
    Browse the repository at this point in the history

  4. add url on top of rag_report_demo_why_some_custom_donot_like_pizza.sql

    @Wang-Yong2018 @jgpruitt
    Wang-Yong2018 authored and jgpruitt committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    630dd1a View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2024

  1. Add grant_ai_usage function

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    26ccdc3 View commit details
    Browse the repository at this point in the history

  2. thinking through privileges. no clear solution yet

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    4533b97 View commit details
    Browse the repository at this point in the history

  3. Add vectorizer config functions

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    f69bd12 View commit details
    Browse the repository at this point in the history

  4. more progress on vectorizer

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    33a23b7 View commit details
    Browse the repository at this point in the history

  5. now sending http request

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    10bf2c6 View commit details
    Browse the repository at this point in the history

  6. Add retries with exponential backoff and logging

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    7d00b99 View commit details
    Browse the repository at this point in the history

  7. in a working state

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    52e4502 View commit details
    Browse the repository at this point in the history

  8. Improve make test-server so it works from host

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    4e140f0 View commit details
    Browse the repository at this point in the history

  9. Add source_pk to vectorizer config

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    ffb8290 View commit details
    Browse the repository at this point in the history

  10. Add asynchronous and external columns to vectorizer

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    0835f29 View commit details
    Browse the repository at this point in the history

  11. Move queue table, funcs, triggers to ai schema

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    fc5d497 View commit details
    Browse the repository at this point in the history

  12. Also check the source table

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    1477682 View commit details
    Browse the repository at this point in the history

  13. Add queue table/schema back to vectorizer table

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    c71fab0 View commit details
    Browse the repository at this point in the history

  14. Allow overriding queue schema and table

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    26eb013 View commit details
    Browse the repository at this point in the history

  15. Remove version from vectorizer test

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    26384ed View commit details
    Browse the repository at this point in the history

  16. Schedule vectorizers with pg_cron or timescaledb jobs

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    de78039 View commit details
    Browse the repository at this point in the history

  17. Add psql_cmd func to make test more readable

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    8e94522 View commit details
    Browse the repository at this point in the history

  18. Validate chunking and formatting configs

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    f6b12c9 View commit details
    Browse the repository at this point in the history

  19. Fix issue with background jobs

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    f27fc72 View commit details
    Browse the repository at this point in the history

  20. Improve vectorizer test

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    c9559bd View commit details
    Browse the repository at this point in the history

  21. Improve vectorizer test

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    73149ce View commit details
    Browse the repository at this point in the history

  22. Rework embedding config

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    54fc809 View commit details
    Browse the repository at this point in the history

  23. Rework scheduling configs

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    41810ab View commit details
    Browse the repository at this point in the history

  24. Rework formatting config

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    6a83d48 View commit details
    Browse the repository at this point in the history

  25. Rework the chunking config

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    02b0d8e View commit details
    Browse the repository at this point in the history

  26. Only allow the owner of a table to vectorizer it

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    e2fae94 View commit details
    Browse the repository at this point in the history

  27. Add vectorizer_queue_depth function

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    19f7eaf View commit details
    Browse the repository at this point in the history

  28. Deal with vectorizers that have no queue

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    bd5bbed View commit details
    Browse the repository at this point in the history

  29. Make vectorizer_queue_depth stable

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    eec6da9 View commit details
    Browse the repository at this point in the history

  30. Add trigger_name to vectorizer

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    1ffe7ae View commit details
    Browse the repository at this point in the history

  31. Add drop_vectorizer function

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    dfa2119 View commit details
    Browse the repository at this point in the history

  32. Fix pgspot issue

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    79abef4 View commit details
    Browse the repository at this point in the history

  33. Allow list of roles to be granted privs

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    1ea3c04 View commit details
    Browse the repository at this point in the history

  34. Add GUC for vectorizer URL

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    cb4df3d View commit details
    Browse the repository at this point in the history

  35. Add default template for formatting_python_template

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    0969761 View commit details
    Browse the repository at this point in the history

  36. Use default python_template

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    d83d05c View commit details
    Browse the repository at this point in the history

  37. Add leading underscore to default queue table name

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    129bdaf View commit details
    Browse the repository at this point in the history

  38. Add indexing configs

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    12a40b5 View commit details
    Browse the repository at this point in the history

  39. Add tests for indexing configs

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    72cdaed View commit details
    Browse the repository at this point in the history

  40. Change target suffix to _embedding_store

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    4dc287a View commit details
    Browse the repository at this point in the history

  41. Change target pk to embedding_uuid

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    86f2c39 View commit details
    Browse the repository at this point in the history

  42. Remove target_column parameter

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    cd471c6 View commit details
    Browse the repository at this point in the history

  43. Add view joining embeddings back to source

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    8f94232 View commit details
    Browse the repository at this point in the history

  44. Add privileges to the view

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    d26fbd2 View commit details
    Browse the repository at this point in the history

  45. Primary key columns must be not null

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    0465e15 View commit details
    Browse the repository at this point in the history

  46. Parse indexing config in test server

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    d4ebe87 View commit details
    Browse the repository at this point in the history

  47. Fully parse request in test server

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    32d1b3e View commit details
    Browse the repository at this point in the history

  48. Add vectorizer_status view

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    7a7cd2e View commit details
    Browse the repository at this point in the history

  49. Add a 'make run' target

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    39363f2 View commit details
    Browse the repository at this point in the history

  50. Remove leading underscores from param names

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    6e78e1a View commit details
    Browse the repository at this point in the history

  51. Don't use reserved work for param

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    89f698c View commit details
    Browse the repository at this point in the history

  52. Fixes for pg_cron and tests of the same

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    66d0f97 View commit details
    Browse the repository at this point in the history

  53. Collection of minor fixes

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    455be82 View commit details
    Browse the repository at this point in the history

  54. Send http request to delete vectorizer

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    29be812 View commit details
    Browse the repository at this point in the history

  55. Minimal dump/restore test

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    9b2812c View commit details
    Browse the repository at this point in the history

  56. Ensure that dump/restore works for non-superusers

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    d048f1e View commit details
    Browse the repository at this point in the history

  57. Use session_user instead of pg_database_owner

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    2fe3d86 View commit details
    Browse the repository at this point in the history

  58. Rename execute_async_ext_vectorizer

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    64f8a01 View commit details
    Browse the repository at this point in the history

  59. Make several funcs immutable

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    d9f62cb View commit details
    Browse the repository at this point in the history

  60. Enable join removal optimization on view

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    6e49fc8 View commit details
    Browse the repository at this point in the history

  61. Move trigger func to ai schema

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    7960777 View commit details
    Browse the repository at this point in the history

  62. Select 1 instead of *

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    608ffc9 View commit details
    Browse the repository at this point in the history

  63. Simplify _vectorizer_schedule_async_ext_job

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    c13a695 View commit details
    Browse the repository at this point in the history

  64. Remove asynchronous and external fields from vectorizer

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    b811ffe View commit details
    Browse the repository at this point in the history

  65. Enable/disable/delete scheduled jobs

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    54fd2b2 View commit details
    Browse the repository at this point in the history

  66. Split large files into smaller ones

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    995b482 View commit details
    Browse the repository at this point in the history

  67. Add config_type to vectorizer configs

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    e6a00bf View commit details
    Browse the repository at this point in the history

  68. Fix drop_vectorizer comment

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    efdf736 View commit details
    Browse the repository at this point in the history

  69. Add vectorizer_errors table 

    To be used by async jobs to be able to
report issues.
    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    ffe0fbb View commit details
    Browse the repository at this point in the history

  70. Add ai.chunking_recursive_character_text_splitter

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    3cafcbe View commit details
    Browse the repository at this point in the history

  71. Add tests for _validate_embedding

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    3655553 View commit details
    Browse the repository at this point in the history

  72. Refactor config validation

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    6562f02 View commit details
    Browse the repository at this point in the history

  73. Check that configs are objects

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    bdce11c View commit details
    Browse the repository at this point in the history

  74. Don't send http request on delete vectorizer

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    d9f65c5 View commit details
    Browse the repository at this point in the history

  75. Move test server to vectorizer dir

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    4643a64 View commit details
    Browse the repository at this point in the history

  76. Rename some functions

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    9849d9d View commit details
    Browse the repository at this point in the history

  77. Move grants to internal functions

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    6ec9527 View commit details
    Browse the repository at this point in the history

  78. Ensure that idempotent and incremental files are strictly ordered

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    1c9be13 View commit details
    Browse the repository at this point in the history

  79. Run tests as non-superuser

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    2fd8339 View commit details
    Browse the repository at this point in the history

  80. Minor cleanup to test fixtures

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    8795f72 View commit details
    Browse the repository at this point in the history

  81. Add tests for privileges

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    aa092c7 View commit details
    Browse the repository at this point in the history

  82. Ensure that vectorizer is usable after dump/restore

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    22b456c View commit details
    Browse the repository at this point in the history

  83. Fix lint-sql

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    79e9735 View commit details
    Browse the repository at this point in the history

  84. Add default separators for recursive chunking

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    13ce785 View commit details
    Browse the repository at this point in the history

  85. Add enqueue_existing flag to create_vectorizer

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    9cba57e View commit details
    Browse the repository at this point in the history

  86. Make postgres version parameterized

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    7bf4cf7 View commit details
    Browse the repository at this point in the history

  87. Don't build sql on make install. Use committed.

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    80d4da4 View commit details
    Browse the repository at this point in the history

  88. Add 0.4.0 sql file for integration tests

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    b8da296 View commit details
    Browse the repository at this point in the history

  89. Fix make help messages

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    5e83fec View commit details
    Browse the repository at this point in the history

  90. Fix python formatting

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    e1d6b9f View commit details
    Browse the repository at this point in the history

  91. Be more strict with paths and working dirs in build for pip

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    bc22fd3 View commit details
    Browse the repository at this point in the history

  92. Need more verbose pip

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    7e047a0 View commit details
    Browse the repository at this point in the history

  93. Python install improvements

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    cca8b51 View commit details
    Browse the repository at this point in the history

  94. Use --no-build-isolation when installing python lib

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    8b80a51 View commit details
    Browse the repository at this point in the history

  95. Fixing pip install for 3.10

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    4f7238b View commit details
    Browse the repository at this point in the history

  96. Use version from __init__.py

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    48d26c4 View commit details
    Browse the repository at this point in the history

  97. Test the contents of the extension

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    c4e7ff6 View commit details
    Browse the repository at this point in the history

  98. Adjust privileges. Revoke from public. Grant to owner

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    4122e6a View commit details
    Browse the repository at this point in the history

  99. Clean up docker/build

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    d1be1d9 View commit details
    Browse the repository at this point in the history

  100. Formatting build.py

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    35de12d View commit details
    Browse the repository at this point in the history

  101. Change vectorizer GUC names

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    ab0372d View commit details
    Browse the repository at this point in the history

  102. pass secrets in event payload

    @alejandrodnm @jgpruitt
    alejandrodnm authored and jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    508c003 View commit details
    Browse the repository at this point in the history

  103. GUC rename

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    defec5b View commit details
    Browse the repository at this point in the history

  104. Bug fix for secrets

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    adff758 View commit details
    Browse the repository at this point in the history

  105. Default grant_to to tsdbadmin 

    Also, warn if roles in grant_to do not exist but
continue anyway.
    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    4456867 View commit details
    Browse the repository at this point in the history

  106. Make sure schema usage is granted too

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    e01c702 View commit details
    Browse the repository at this point in the history

  107. Create vector indexes in background job

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    07958c7 View commit details
    Browse the repository at this point in the history

  108. Add pgvectorscale to docker image for testing

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    2720e9c View commit details
    Browse the repository at this point in the history

  109. Make trigger func security definer

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    9ab992c View commit details
    Browse the repository at this point in the history

  110. Bug fixes for vector index creation

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    5b860f2 View commit details
    Browse the repository at this point in the history

  111. Explain security definer on trigger in comment

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    c378a7d View commit details
    Browse the repository at this point in the history

  112. Pretty comments

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    cf4a830 View commit details
    Browse the repository at this point in the history

  113. Remove pgcron scheduling implementation

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    7550c50 View commit details
    Browse the repository at this point in the history

  114. Fix issue with docker ps hanging

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    dfd4176 View commit details
    Browse the repository at this point in the history

  115. Remove columns param from formatting_python_template

    @jgpruitt
    jgpruitt committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    a4ae9fb View commit details
    Browse the repository at this point in the history

Commits on Sep 17, 2024

  1. Test diskann index creation

    @jgpruitt
    jgpruitt committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    79e22f7 View commit details
    Browse the repository at this point in the history

  2. Test hnsw index creation

    @jgpruitt
    jgpruitt committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    29c57a9 View commit details
    Browse the repository at this point in the history

  3. Add vectorizer processing config

    @jgpruitt
    jgpruitt committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    511ae7d View commit details
    Browse the repository at this point in the history

  4. Add concurrency setting to processing config

    @jgpruitt
    jgpruitt committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    028a72c View commit details
    Browse the repository at this point in the history

  5. fix: create test users by a superuser

    @jgpruitt
    jgpruitt committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    1637705 View commit details
    Browse the repository at this point in the history

  6. Remove drop of pgcron in tests

    @jgpruitt
    jgpruitt committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    ef73101 View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2024

  1. fix: correct the pg_setting name for url

    @jgpruitt
    jgpruitt committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    f177de5 View commit details
    Browse the repository at this point in the history

  2. fix: correct the guc name in vectorizer test

    @jgpruitt
    jgpruitt committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    e292153 View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2024

  1. fix: minor bug fixes to build.py

    @jgpruitt
    jgpruitt committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    2ef1ff3 View commit details
    Browse the repository at this point in the history

Commits on Sep 25, 2024

  1. Add openai_chat_complete_simple (and tests) 

    Current openai_chat_complete function requires choosing the model,
submitting the message in a json object, and parsing the json object
output. This can feel cumbersome to do.

This openai_chat_complete_simple chooses a default model, only requires
the message to be passed as text, and returns the response as text. This
should be easier to use, albeit maybe not as powerful.

Future work:

- Consider making the default model an env variable

- Repeat for the other LLMs (Anthropic, Cohere, Ollama)
    @akulkarni @jgpruitt
    akulkarni authored and jgpruitt committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    022cd47 View commit details
    Browse the repository at this point in the history

Commits on Sep 30, 2024

  1. fix: Add support for recursive_character_text_splitter to test server

    @jgpruitt
    jgpruitt committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    bfcf608 View commit details
    Browse the repository at this point in the history

  2. fix: raise exception if no pk on source

    @jgpruitt
    jgpruitt committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    0a7a44e View commit details
    Browse the repository at this point in the history

  3. fix: ensure column to chunk it text-like type

    @jgpruitt
    jgpruitt committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    7024e34 View commit details
    Browse the repository at this point in the history

  4. fix: update test actuals for new function

    @jgpruitt
    jgpruitt committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    39b63f5 View commit details
    Browse the repository at this point in the history

  5. feat: execute multiple vectorizers for large queue

    @jgpruitt
    jgpruitt committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    c6d30c7 View commit details
    Browse the repository at this point in the history

  6. fix: only count what we have to 

    Co-authored-by: Matvey Arye <[email protected]>
Signed-off-by: John Pruitt <[email protected]>
    @jgpruitt @cevian
    jgpruitt and cevian committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    69c1851 View commit details
    Browse the repository at this point in the history

  7. fix: build sql

    @jgpruitt
    jgpruitt committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    2469bcc View commit details
    Browse the repository at this point in the history

Commits on Oct 1, 2024

  1. feat: documentation for version 0.4.0

    @jgpruitt
    jgpruitt committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    7daaa12 View commit details
    Browse the repository at this point in the history

  2. chore: add debug msg and null-safe check to vec job

    @jgpruitt
    jgpruitt committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    8ae6a71 View commit details
    Browse the repository at this point in the history

Commits on Oct 2, 2024

  1. Add ts-vector team to CODEOWNERS

    @adolsalamanca @jgpruitt
    adolsalamanca authored and jgpruitt committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    4b4b386 View commit details
    Browse the repository at this point in the history

  2. chore: move extension python to subdir

    @jgpruitt
    jgpruitt committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    6d1dead View commit details
    Browse the repository at this point in the history

  3. chore: reorganize and improve handling of python deps

    @jgpruitt
    jgpruitt committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    30e0533 View commit details
    Browse the repository at this point in the history

  4. feat: install/uninstall/clean make targets for vectorizer

    @jgpruitt
    jgpruitt committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    2b27a9d View commit details
    Browse the repository at this point in the history

  5. feat: add dockerfile for vectorizer and related make targets

    @jgpruitt
    jgpruitt committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    7dfd6f2 View commit details
    Browse the repository at this point in the history

  6. chore: update make help

    @jgpruitt
    jgpruitt committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    547d64d View commit details
    Browse the repository at this point in the history

Commits on Oct 3, 2024

  1. feat: use advisory lock to protect against redundant index builds

    @jgpruitt
    jgpruitt committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    da81af8 View commit details
    Browse the repository at this point in the history

  2. fix: index creation bug when options specified

    @jgpruitt
    jgpruitt committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    c29b689 View commit details
    Browse the repository at this point in the history

  3. feat: test index creation under concurrency

    @jgpruitt
    jgpruitt committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    a23bc41 View commit details
    Browse the repository at this point in the history

Commits on Oct 4, 2024

  1. fix: do not install vectorizer cli by default

    @jgpruitt
    jgpruitt committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    e8ca37b View commit details
    Browse the repository at this point in the history

  2. fix: make setup.cfg compatible with python 3.10

    @jgpruitt
    jgpruitt committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    c32e4db View commit details
    Browse the repository at this point in the history

  3. fix: remove pip arg not supported on old versions

    @jgpruitt
    jgpruitt committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    8070011 View commit details
    Browse the repository at this point in the history

  4. feat: add config option to only build vec idx when q empty

    @jgpruitt
    jgpruitt committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    4f3f2c6 View commit details
    Browse the repository at this point in the history

Commits on Oct 7, 2024

  1. feat: add vectorizer cli tool

    @jgpruitt
    jgpruitt committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    161b48e View commit details
    Browse the repository at this point in the history

Commits on Oct 8, 2024

  1. fix: fix security issues with openai_chat_complete_simple

    @jgpruitt
    jgpruitt committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    a7180b0 View commit details
    Browse the repository at this point in the history

  2. fix: small sql lint issues

    @jgpruitt
    jgpruitt committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    fd4a5a5 View commit details
    Browse the repository at this point in the history

  3. feat: make certain tests run by default

    @jgpruitt
    jgpruitt committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    09883c9 View commit details
    Browse the repository at this point in the history

  4. feat: add ci config

    @jgpruitt
    jgpruitt committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    57df731 View commit details
    Browse the repository at this point in the history

Commits on Oct 10, 2024

  1. refactor: use monorepo structure (#101) 

    refactor: use monorepo structure

* refactor: update .gitignore paths

* refactor: path fixes and clarifications in build.py

* chore: fix formatting in extension tests

* refactor: update paths in test_contents

* refactor: update paths in test_dump_restore

* refactor: update paths in test_privileges

* refactor: update paths in test_cli

* fix: format sql identifiers in test_vectorizer

* refactor: calc vcr cassette dir

* refactor: use single tiktoken_cache across tests

* fix: handle when tictoken_cache is str in cli

* chore: fix formating and reenable ci check

* chore: run ci vectorizer tests not in docker

---------

Co-authored-by: John Pruitt <[email protected]>
    @alejandrodnm @jgpruitt
    alejandrodnm and jgpruitt authored Oct 10, 2024
    Configuration menu
    Copy the full SHA
    a6b616d View commit details
    Browse the repository at this point in the history

  2. feat: detect naming collisions and raise helpful errors

    @jgpruitt
    jgpruitt committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    eb75b36 View commit details
    Browse the repository at this point in the history

  3. chore: change scheduling default to 5 minutes

    @jgpruitt
    jgpruitt committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    153bb90 View commit details
    Browse the repository at this point in the history

  4. refactor: update test image path

    @jgpruitt
    jgpruitt committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    a1c3201 View commit details
    Browse the repository at this point in the history

  5. chore: rename processing_cloud_functions to processing_default

    @jgpruitt
    jgpruitt committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    108c9d4 View commit details
    Browse the repository at this point in the history

  6. feat: if scheduling is none, indexing must be none

    @jgpruitt
    jgpruitt committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    d75af9d View commit details
    Browse the repository at this point in the history

Commits on Oct 11, 2024

  1. chore: add docker-compose 

    Adds a Docker compose example.

Installs the pgai extension in the when building the Docker container.

Enables auto prefix for the env vars of the vectorizer cli options.
    @alejandrodnm
    alejandrodnm committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    0f8ef77 View commit details
    Browse the repository at this point in the history