Skip to content

results: gemma4:26b SimpleQA 73.1% (300q, 2026-04-14)#18

Open
LearningCircuit wants to merge 1 commit intomainfrom
add-gemma4-26b-2026-04-14
Open

results: gemma4:26b SimpleQA 73.1% (300q, 2026-04-14)#18
LearningCircuit wants to merge 1 commit intomainfrom
add-gemma4-26b-2026-04-14

Conversation

@LearningCircuit
Copy link
Copy Markdown
Owner

Summary

  • gemma4:26b on SimpleQA, 300 questions, langgraph_agent via serper
  • 73.1% (219/300), 23.6s avg per question, date_tested 2026-04-14

Notes

LDR v1.5.6 exporter had the known strategy-mislabeling bug (fixed in
LearningCircuit/local-deep-research#3442). Relabeled from source_based
to langgraph_agent.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant