Code

Metadata filtering#124

Code

Merged

asg017 merged 83 commits intomainasg017/sqlite-vec:mainfrom metadata-filteringasg017/sqlite-vec:metadata-filteringCopy head branch name to clipboardNov 20, 2024

+7,366-110

Commits

Commits on Oct 14, 2024

• initial pass at PARTITION KEY support.

  asg017

  committed
  776d86c

  Copy full SHA for 776d86c

• Initial pass, allow auxiliary columns on vec0 virtual tables

  asg017

  committed
  8a7bde9

  Copy full SHA for 8a7bde9

• update TODO

  asg017

  committed
  bfb279c

  Copy full SHA for bfb279c

Commits on Oct 15, 2024

• Initial pass at metadata filtering

  asg017

  committed
  adddea0

  Copy full SHA for adddea0

Commits on Nov 5, 2024

• unit tests

  asg017

  committed
  f36d4a0

  Copy full SHA for f36d4a0

Commits on Nov 13, 2024

• gha this PR branch

  asg017

  committed
  84d6a14

  Copy full SHA for 84d6a14

• fixup tests

  asg017

  committed
  c7bcf58

  Copy full SHA for c7bcf58

• doc internal

  asg017

  committed
  4cb891a

  Copy full SHA for 4cb891a

• fix tests, KNN/rowids in

  asg017

  committed
  8369dfe

  Copy full SHA for 8369dfe

• define SQLITE_INDEX_CONSTRAINT_OFFSET

  asg017

  committed
  1a21336

  Copy full SHA for 1a21336

• whoops

  asg017

  committed
  26fbdf2

  Copy full SHA for 26fbdf2

• update tests, syrupy, use uv

  asg017

  committed
  76b8247

  Copy full SHA for 76b8247

• un ignore pyproject.toml

  asg017

  committed
  99095c7

  Copy full SHA for 99095c7

• dot

  asg017

  committed
  5d571eb

  Copy full SHA for 5d571eb

• tests/

  asg017

  committed
  5949209

  Copy full SHA for 5949209

• type error?

  asg017

  committed
  3c1fb0a

  Copy full SHA for 3c1fb0a

• win: .exe, update error name

  asg017

  committed
  78717dd

  Copy full SHA for 78717dd

• try fix macos python, paren around expr?

  asg017

  committed
  f3d4bb3

  Copy full SHA for f3d4bb3

• win bash?

  asg017

  committed
  afb3826

  Copy full SHA for afb3826

• dbg :(

  asg017

  committed
  c6df446

  Copy full SHA for c6df446

• explicit error

  asg017

  committed
  8149761

  Copy full SHA for 8149761

• op

  asg017

  committed
  93b3433

  Copy full SHA for 93b3433

• dbg win

  asg017

  committed
  0bd9fc5

  Copy full SHA for 0bd9fc5

• win ./tests/.venv/Scripts/python.exe

  asg017

  committed
  21b11e1

  Copy full SHA for 21b11e1

• block UPDATEs on partition key values for now

  asg017

  committed
  03f29d5

  Copy full SHA for 03f29d5

• Merge branch 'main' into partition-by

  asg017

  authored
  f00aa68

  Copy full SHA for f00aa68

• Merge branch 'partition-by' into auxiliary

  asg017

  committed
  0eece06

  Copy full SHA for 0eece06

• test this branch

  asg017

  committed
  afbcbb7

  Copy full SHA for afbcbb7

• accidentally removved "partition key type mistmatch" block during merge

  asg017

  committed
  da14fa1

  Copy full SHA for da14fa1

• typo ugh

  asg017

  committed
  70c9c17

  Copy full SHA for 70c9c17

• bruv

  asg017

  committed
  93218e4

  Copy full SHA for 93218e4

• start aux snapshots

  asg017

  committed
  163654b

  Copy full SHA for 163654b

• drop aux shadow table on destroy

  asg017

  committed
  d6adbc9

  Copy full SHA for d6adbc9

• enforce column types

  asg017

  committed
  7d4c023

  Copy full SHA for 7d4c023

• block WHERE constraints on auxiliary columns in KNN queries

  asg017

  committed
  743511a

  Copy full SHA for 743511a

• support delete

  asg017

  committed
  a394c5f

  Copy full SHA for a394c5f

• support UPDATE on auxiliary columns

  asg017

  committed
  5d9b923

  Copy full SHA for 5d9b923

• Merge branch 'auxiliary' into metadata-filtering

  asg017

  committed
  65c0098

  Copy full SHA for 65c0098

Commits on Nov 14, 2024

• test this PR

  asg017

  committed
  6a224df

  Copy full SHA for 6a224df

• dont inline that

  asg017

  committed
  9cba8ff

  Copy full SHA for 9cba8ff

• test-metadata.py

  asg017

  committed
  3e6759c

  Copy full SHA for 3e6759c

• memzero text buffer

  asg017

  committed
  fef4997

  Copy full SHA for fef4997

• stress test

  asg017

  committed
  b04b647

  Copy full SHA for b04b647

• more snpashot tests

  asg017

  committed
  06e28da

  Copy full SHA for 06e28da

• rm double/int32, just float/int64

  asg017

  committed
  9fffdc4

  Copy full SHA for 9fffdc4

• finish type checking

  asg017

  committed
  f12be52

  Copy full SHA for f12be52

• long text support

  asg017

  committed
  8132f26

  Copy full SHA for 8132f26

• DELETE support

  asg017

  committed
  ae601dc

  Copy full SHA for ae601dc

• UPDATE support

  asg017

  committed
  c1055ab

  Copy full SHA for c1055ab

• fix snapshot names

  asg017

  committed
  c4ece98

  Copy full SHA for c4ece98

• drop not-used in eqp

  asg017

  committed
  ab1f6f2

  Copy full SHA for ab1f6f2

• small fixes

  asg017

  committed
  3965029

  Copy full SHA for 3965029

Commits on Nov 15, 2024

• boolean comparison handling

  asg017

  committed
  a1a6442

  Copy full SHA for a1a6442

• ensure error is raised when long string constraint

  asg017

  committed
  1c13c91

  Copy full SHA for 1c13c91

• new version string for beta builds

  asg017

  committed
  c337129

  Copy full SHA for c337129

• typo whoops

  asg017

  committed
  052ba4b

  Copy full SHA for 052ba4b

Commits on Nov 17, 2024

• ann-filtering-benchmark directory

  asg017

  committed
  f55e14c

  Copy full SHA for f55e14c

• test-case

  asg017

  committed
  7f47409

  Copy full SHA for 7f47409

• updates

  asg017

  committed
  da29ace

  Copy full SHA for da29ace

• fix aux column error when using non-default rowid values, needs test

  asg017

  committed
  1a216a6

  Copy full SHA for 1a216a6

Commits on Nov 18, 2024

• refactor some text knn filtering

  asg017

  committed
  10a2216

  Copy full SHA for 10a2216

• rowids blob read only on text metadata filters

  asg017

  committed
  b527a3d

  Copy full SHA for b527a3d

• refactor

  asg017

  committed
  07793b3

  Copy full SHA for 07793b3

• add failing test causes for non eq text knn

  asg017

  committed
  3162220

  Copy full SHA for 3162220

• text knn NE

  asg017

  committed
  4ba167c

  Copy full SHA for 4ba167c

• test cases diff

  asg017

  committed
  3db69bd

  Copy full SHA for 3db69bd

• GT

  asg017

  committed
  1ec1b89

  Copy full SHA for 1ec1b89

• text knn GT/GE fixes

  asg017

  committed
  df29e31

  Copy full SHA for df29e31

• text knn LT/LE

  asg017

  committed
  018e978

  Copy full SHA for 018e978

• clean

  asg017

  committed
  0db2e52

  Copy full SHA for 0db2e52

Commits on Nov 19, 2024

• vtab_in handling

  asg017

  committed
  7b67c78

  Copy full SHA for 7b67c78

• unblock aux failures for now

  asg017

  committed
  d0993b7

  Copy full SHA for d0993b7

• guard sqlite3_vtab_in

  asg017

  committed
  0123b24

  Copy full SHA for 0123b24

• else in guard?

  asg017

  committed
  4039328

  Copy full SHA for 4039328

Commits on Nov 20, 2024

• fixes and tests

  asg017

  committed
  a657b3a

  Copy full SHA for a657b3a

• add broken shadow table test

  asg017

  committed
  e99e31f

  Copy full SHA for e99e31f

• rename _metadata_chunksNN shadown table to _metadatachunksNN, for proper shadowName detection

  asg017

  committed
  0b17547

  Copy full SHA for 0b17547

• _metadata_text_NN shadow tables to _metadatatextNN

  asg017

  committed
  86df498

  Copy full SHA for 86df498

• SQLITE_VEC_VERSION_MAJOR SQLITE_VEC_VERSION_MINOR and SQLITE_VEC_VERSION_PATCH in sqlite-vec.h

  asg017

  committed
  a12c0d7

  Copy full SHA for a12c0d7

• _info shadow table

  asg017

  committed
  672868d

  Copy full SHA for 672868d

• Merge branch 'main' into metadata-filtering

  asg017

  committed
  e414b97

  Copy full SHA for e414b97

• forgot to update aux snapshot?

  asg017

  committed
  804cea5

  Copy full SHA for 804cea5

• fix aux tests

  asg017

  committed
  a8d0a28

  Copy full SHA for a8d0a28