Skip to content

Update DeepEye-SQL results for 27B model#205

Open
BugMaker-Boyan wants to merge 2 commits into
bird-bench:mainfrom
BugMaker-Boyan:agent/update-deepeye-qwen3-6-27b
Open

Update DeepEye-SQL results for 27B model#205
BugMaker-Boyan wants to merge 2 commits into
bird-bench:mainfrom
BugMaker-Boyan:agent/update-deepeye-qwen3-6-27b

Conversation

@BugMaker-Boyan

Copy link
Copy Markdown
Contributor

Summary

  • Update the DeepEye-SQL 27B entry to display 27B in the parameter column.
  • Set the EX scores to 74.49 on Dev and 78.42 on Test.
  • Add the R-VES Test score of 72.26.
  • Remove the previous DeepEye-SQL 3B-MOE entries.

Validation

  • git diff --check
  • Verified the updated HTML contains two July 10, 2026 DeepEye-SQL rows with 27B and no DeepEye-SQL 3B-MOE rows.

@BugMaker-Boyan BugMaker-Boyan marked this pull request as ready for review July 10, 2026 05:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant