Skip to content

πŸ”΄ Nightly eval regression β€” agent eval gate failingΒ #1382

Description

@github-actions

The nightly eval (eval-nightly.yml) failed β€” a canary failure or a >5% regression vs the recorded baseline.

Triage: open the run logs, find the failing agent/scenarios, and fix the prompt (src/server/agents/configs) or the scenario (evals/scenarios). This issue auto-closes when the nightly is green again.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions