Skip to content

Commit b5ba4f7

Browse files
committed
docs: bump to v1.5.2 — async eval_case bug fix
1 parent f7e0ddb commit b5ba4f7

5 files changed

Lines changed: 21 additions & 7 deletions

File tree

docs/changelog.md

Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -8,6 +8,20 @@ All notable changes to SynapseKit are documented here.
88

99
---
1010

11+
## v1.5.2 — Async eval_case bug fix
12+
13+
**Released:** 2026-04-09
14+
15+
### Fixed
16+
17+
- **`@eval_case` async functions** — the decorator wrapped async functions in a sync `wrapper`, causing `inspect.iscoroutinefunction()` to return `False`; the CLI skipped `asyncio.run()` and passed the raw coroutine to `float()`, raising `TypeError: float() argument must be a string or a real number, not 'coroutine'`. Fixed by adding an `async_wrapper` branch for async eval case functions.
18+
19+
**Upgrade:** `pip install --upgrade synapsekit` or pin `synapsekit-version: "1.5.2"` in your EvalCI workflow.
20+
21+
**Stats:** 1752 tests · 30 LLM providers · 46 tools · 33 loaders · 9 text splitters · 9 vector store backends
22+
23+
---
24+
1125
## v1.5.1 — Security hardening
1226

1327
**Released:** 2026-04-09

docs/evalci/action-reference.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -29,7 +29,7 @@ Complete reference for all EvalCI inputs, outputs, and configuration options.
2929
| `path` | `.` | Path to eval files or directory. EvalCI discovers all `@eval_case` functions recursively. |
3030
| `threshold` | `0.7` | Global minimum score (0.0–1.0). Cases scoring below this fail. |
3131
| `extras` | `openai` | pip extras to install with synapsekit. Use comma-separated values for multiple providers. |
32-
| `synapsekit-version` | `latest` | Pin a specific synapsekit version (e.g. `1.5.1`) or `latest`. |
32+
| `synapsekit-version` | `latest` | Pin a specific synapsekit version (e.g. `1.5.2`) or `latest`. |
3333
| `github-token` | `${{ github.token }}` | GitHub token used to post PR comments. The default works for most repos. |
3434
| `fail-on-regression` | `false` | Set to `true` to also fail if scores regress compared to a saved baseline. |
3535
| `token` | _(empty)_ | Reserved for future EvalCI backend API token. Leave blank for now. |
@@ -102,7 +102,7 @@ By default EvalCI always installs the latest `synapsekit`. To pin:
102102
```yaml
103103
- uses: SynapseKit/evalci@v1
104104
with:
105-
synapsekit-version: "1.5.1"
105+
synapsekit-version: "1.5.2"
106106
```
107107

108108
---

docs/evalci/examples.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -158,7 +158,7 @@ jobs:
158158
with:
159159
path: tests/evals
160160
threshold: "0.90"
161-
synapsekit-version: "1.5.1"
161+
synapsekit-version: "1.5.2"
162162
env:
163163
OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
164164
```

docs/intro.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -94,4 +94,4 @@ Output parsers (JSON, Pydantic, List), prompt templates (standard, chat, few-sho
9494

9595
## Version
9696

97-
Current version: **1.5.1** — see the [Changelog](/docs/changelog) and [Roadmap](/docs/roadmap).
97+
Current version: **1.5.2** — see the [Changelog](/docs/changelog) and [Roadmap](/docs/roadmap).

docusaurus.config.ts

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -115,8 +115,8 @@ const config: Config = {
115115
respectPrefersColorScheme: true,
116116
},
117117
announcementBar: {
118-
id: 'v151',
119-
content: '🔒 SynapseKit v1.5.1Security hardening: SQL injection, shell injection, path traversal, SSRF, TOCTOU fixes + 4 new loaders. <a href="/synapsekit-docs/docs/changelog">See what\'s new →</a>',
118+
id: 'v152',
119+
content: '🐛 SynapseKit v1.5.2Async <code>@eval_case</code> bug fix for EvalCI. <a href="/synapsekit-docs/docs/changelog">See what\'s new →</a>',
120120
backgroundColor: '#161b22',
121121
textColor: '#8b949e',
122122
isCloseable: true,
@@ -149,7 +149,7 @@ const config: Config = {
149149
{
150150
type: 'html',
151151
position: 'left',
152-
value: '<span class="navbar__version">v1.5.1</span>',
152+
value: '<span class="navbar__version">v1.5.2</span>',
153153
},
154154
{
155155
href: 'https://discord.gg/unn4cXXH',

0 commit comments

Comments
 (0)