Skip to content

Add ANN#11

Open
Ankur Goyal (ankrgyl) wants to merge 11 commits into
vectorsfrom
vectors-ann
Open

Add ANN#11
Ankur Goyal (ankrgyl) wants to merge 11 commits into
vectorsfrom
vectors-ann

Conversation

@ankrgyl
Copy link
Copy Markdown

No description provided.

Ankur Goyal (ankrgyl) and others added 11 commits January 28, 2026 14:43
* initial commit

* support named vectors

* optimize format

* clustering example

* Vector -> VectorMap

* fix build

* tests

* change to batch interface

* bump

* fix

* cache presence bits and add some more docs

* rm old docs

* wip: comments

* nicer docs

* cow

* fix docs

* split bitset

* change ot a hash map

* throw an error

* more comments

* comments
The original implementation for opening a vector reader would swallow
all IOErrors into None, meaning we might ignore vector data that exists
due to arbitrary IO errors.

It seems like the original intent was to gracefully skip over vector
data when the tantivy index doesn't contain any vector files, even if
the schema does. But this should be handled by optionally initializing
the the vector reader file handle. Reading the subsequent data should
not have to handle the file missing.
…r-error-handling

Stricter error handling for vector reader
We were using a panicking version of the datetime converter which would
fail on out-of-range datetimes, e.g. "9999-12-31T23:59:59-07:00". Now we
fall back to string.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants