Skip to content

test: verify persistence benchmark CI workflow#322

Open
deven96 wants to merge 1 commit intomainfrom
test/persistence-benchmark-ci
Open

test: verify persistence benchmark CI workflow#322
deven96 wants to merge 1 commit intomainfrom
test/persistence-benchmark-ci

Conversation

@deven96
Copy link
Owner

@deven96 deven96 commented Mar 23, 2026

Summary

Test PR to verify the persistence benchmark CI workflow works correctly now that the baseline exists on main.

Changes

  • Added a file header comment to the persistence benchmark (trivial change)

Purpose

This PR will trigger the persistence-benchmark.yml workflow when labeled with benchmark-persistence to verify:

  • ✅ Benchmark runs on main branch (baseline now exists)
  • ✅ Benchmark runs on PR branch
  • ✅ Comparison between main and PR is generated
  • ✅ Results are posted as a PR comment

After verification, this PR can be closed without merging.

@deven96 deven96 added the benchmark-persistence Trigger persistence benchmark CI workflow label Mar 23, 2026
@github-actions
Copy link

github-actions bot commented Mar 23, 2026

Test Results

115 tests   115 ✅  4m 55s ⏱️
 28 suites    0 💤
  3 files      0 ❌

Results for commit 1289764.

♻️ This comment has been updated with latest results.

@deven96
Copy link
Owner Author

deven96 commented Mar 23, 2026

Bitcode seems to be failing with a sequence without a length

@github-actions
Copy link

Benchmark Results

group                                                        main                                   pr
-----                                                        ----                                   --
predicate_query_with_index/size_100                          1.01      3.1±0.00µs        ? ?/sec    1.00      3.0±0.00µs        ? ?/sec
predicate_query_with_index/size_1000                         1.00     28.9±0.02µs        ? ?/sec    1.00     28.8±0.02µs        ? ?/sec
predicate_query_with_index/size_10000                        1.01    401.0±2.62µs        ? ?/sec    1.00    398.0±0.17µs        ? ?/sec
predicate_query_with_index/size_100000                       1.01      4.9±0.01ms        ? ?/sec    1.00      4.9±0.00ms        ? ?/sec
predicate_query_without_index/size_100                       1.00      6.8±0.00µs        ? ?/sec    1.02      6.9±0.01µs        ? ?/sec
predicate_query_without_index/size_1000                      1.02    102.7±0.08µs        ? ?/sec    1.00    100.7±0.07µs        ? ?/sec
predicate_query_without_index/size_10000                     1.07    802.4±2.15µs        ? ?/sec    1.00    751.5±1.47µs        ? ?/sec
predicate_query_without_index/size_100000                    1.00     11.4±0.17ms        ? ?/sec    1.02     11.7±0.18ms        ? ?/sec
store_batch_insertion_without_predicates/size_100            1.00    197.2±1.92µs        ? ?/sec    1.01    199.0±2.34µs        ? ?/sec
store_batch_insertion_without_predicates/size_1000           1.02  1326.3±12.33µs        ? ?/sec    1.00  1300.0±16.86µs        ? ?/sec
store_batch_insertion_without_predicates/size_10000          1.00     14.2±0.17ms        ? ?/sec    1.00     14.1±0.06ms        ? ?/sec
store_batch_insertion_without_predicates/size_100000         1.00    141.6±2.16ms        ? ?/sec    1.02    144.8±1.44ms        ? ?/sec
store_retrieval_linear_cosine_similarity/size_100            1.00     90.0±0.56µs        ? ?/sec    1.00     89.9±0.35µs        ? ?/sec
store_retrieval_linear_cosine_similarity/size_1000           1.00   760.2±12.15µs        ? ?/sec    1.01   765.3±16.44µs        ? ?/sec
store_retrieval_linear_cosine_similarity/size_10000          1.01      7.1±0.05ms        ? ?/sec    1.00      7.1±0.02ms        ? ?/sec
store_retrieval_linear_cosine_similarity/size_100000         1.01     75.4±0.40ms        ? ?/sec    1.00     75.0±0.19ms        ? ?/sec
store_retrieval_linear_dot_product/size_100                  1.00     89.4±0.43µs        ? ?/sec    1.00     89.1±0.62µs        ? ?/sec
store_retrieval_linear_dot_product/size_1000                 1.00    745.7±9.21µs        ? ?/sec    1.00   745.7±11.14µs        ? ?/sec
store_retrieval_linear_dot_product/size_10000                1.00      7.0±0.03ms        ? ?/sec    1.01      7.1±0.06ms        ? ?/sec
store_retrieval_linear_dot_product/size_100000               1.00     73.0±0.45ms        ? ?/sec    1.01     73.9±0.67ms        ? ?/sec
store_retrieval_linear_euclidean_distance/size_100           1.01     89.1±0.76µs        ? ?/sec    1.00     88.6±0.59µs        ? ?/sec
store_retrieval_linear_euclidean_distance/size_1000          1.00    733.3±6.21µs        ? ?/sec    1.00    732.8±7.99µs        ? ?/sec
store_retrieval_linear_euclidean_distance/size_10000         1.00      7.0±0.03ms        ? ?/sec    1.00      7.0±0.04ms        ? ?/sec
store_retrieval_linear_euclidean_distance/size_100000        1.00     73.6±0.37ms        ? ?/sec    1.00     74.0±0.83ms        ? ?/sec
store_retrieval_no_condition/size_100                        1.00     90.4±0.75µs        ? ?/sec    1.00     90.4±0.35µs        ? ?/sec
store_retrieval_no_condition/size_1000                       1.00   766.9±10.50µs        ? ?/sec    1.03   786.9±24.00µs        ? ?/sec
store_retrieval_no_condition/size_10000                      1.00      7.1±0.04ms        ? ?/sec    1.00      7.1±0.04ms        ? ?/sec
store_retrieval_no_condition/size_100000                     1.00     75.5±0.17ms        ? ?/sec    1.01     76.5±0.52ms        ? ?/sec
store_retrieval_non_linear_hnsw/size_100                     1.01    180.1±0.52µs        ? ?/sec    1.00    177.9±0.85µs        ? ?/sec
store_retrieval_non_linear_hnsw/size_1000                    1.01    504.2±1.09µs        ? ?/sec    1.00    498.2±0.81µs        ? ?/sec
store_retrieval_non_linear_hnsw/size_10000                   1.00   1736.7±3.64µs        ? ?/sec    1.07   1857.9±3.60µs        ? ?/sec
store_retrieval_non_linear_hnsw/size_100000                  1.00     10.3±0.07ms        ? ?/sec    1.17     12.0±0.12ms        ? ?/sec
store_retrieval_non_linear_kdtree/size_100                   1.00    182.4±0.57µs        ? ?/sec    1.00    182.8±0.70µs        ? ?/sec
store_retrieval_non_linear_kdtree/size_1000                  1.00   1157.0±1.99µs        ? ?/sec    1.00   1155.6±1.21µs        ? ?/sec
store_retrieval_non_linear_kdtree/size_10000                 1.00     11.8±0.03ms        ? ?/sec    1.01     11.9±0.04ms        ? ?/sec
store_retrieval_non_linear_kdtree/size_100000                1.00    147.8±1.43ms        ? ?/sec    1.01    148.5±0.95ms        ? ?/sec
store_sequential_insertion_without_predicates/size_100       1.00    263.8±0.58µs        ? ?/sec    1.00    264.0±0.67µs        ? ?/sec
store_sequential_insertion_without_predicates/size_1000      1.00      2.6±0.01ms        ? ?/sec    1.01      2.6±0.01ms        ? ?/sec
store_sequential_insertion_without_predicates/size_10000     1.00     25.9±0.06ms        ? ?/sec    1.01     26.1±0.06ms        ? ?/sec
store_sequential_insertion_without_predicates/size_100000    1.00    258.4±0.78ms        ? ?/sec    1.01    260.0±0.31ms        ? ?/sec

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

benchmark-persistence Trigger persistence benchmark CI workflow

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant