test: EvalCI smoke test

Author: AmitoVrito

.github/workflows/eval.yml

@@ -0,0 +1,16 @@
+name: EvalCI Smoke Test
+
+on:
+  push:
+  pull_request:
+
+jobs:
+  eval:
+    runs-on: ubuntu-latest
+    steps:
+      - uses: actions/checkout@v4
+      - uses: SynapseKit/evalci@v1
+        with:
+          path: tests/evals
+          threshold: "0.80"
+          extras: "openai"

README.md

@@ -0,0 +1,3 @@
+# EvalCI E2E Test Repo
+
+Smoke test for [EvalCI](https://github.com/SynapseKit/evalci).

tests/evals/eval_smoke.py

@@ -0,0 +1,10 @@
+from synapsekit import eval_case
+
+@eval_case(min_score=0.80)
+async def eval_passing():
+    """Simulates a passing eval case — no API key needed."""
+    return {"score": 0.92, "cost_usd": 0.001, "latency_ms": 150}
+
+@eval_case(min_score=0.70)
+async def eval_another_passing():
+    return {"score": 0.85, "cost_usd": 0.002, "latency_ms": 300}