You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Follow-up from the built-in search quality arc (feat/builtin-search-revamp). Two recurring-maintenance workflows so the eval corpus and the domain-credibility list never fossilize.
A scheduled GitHub Action (monthly or quarterly) pulls the latest upstream license-clean sources (arosh CC0 copycat list, quenhus Unlicense SEO-spam/wiki-mirror lists), regenerates src-tauri/src/websearch/credibility_domains.txt, and opens a PR when the diff is non-empty.
Phase 1: a workflow_dispatch job that runs the live answer-capture harness (tests/live_answer_capture.rs) and uploads the answers JSONL as an artifact. Caveat to validate first: search engines heavily rate-limit GitHub runner IPs; if DDG/Mojeek block from runners, the harness stays a dev-machine tool and the workflow only runs the hermetic corpus checks.
Phase 2 (after phase 1 proves viable): the pairwise position-swapped LLM-judge step from docs/search-eval.md over two capture runs (baseline vs candidate), judge model and API budget to be decided. Dev-time tooling: exempt from the keyless/no-server product constraints.
Corpus growth stays human-curated: rows get added from real observed failures (the pattern that caught every bug so far), not auto-generated. Automation runs the exam; it does not write the exam.
Explicitly out of scope
Runtime/live list updates from the app (violates no-phone-home).
Follow-up from the built-in search quality arc (feat/builtin-search-revamp). Two recurring-maintenance workflows so the eval corpus and the domain-credibility list never fossilize.
1. Credibility-list refresh (scheduled, automated PR)
2. Eval runs (manual trigger first, schedule later)
Explicitly out of scope