feat(skill): add substreams-sink-deploy skill#5
Conversation
End-to-end guide for getting Substreams data into a destination: - Decision tree: SQL / Files / PubSub / Webhook / Subgraph / SDK - Build-side vs run-side architecture - Per-sink: install, required output proto, run command, cursor mgmt - Hosted vs self-hosted decision matrix - Production patterns: backfill+live, monitoring, reorg safety - Common pitfalls: wrong proto type, missing cursor tables, etc. Complements existing skills: - substreams-dev: builds modules - substreams-sql: db_out / DatabaseChanges build patterns - substreams-sink: SDK consumption (Go/JS/Rust) Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
From T7.1 trial findings: - Tighten description with explicit triggers (run/deploy/operate verbs) - Add explicit boundary vs substreams-sql skill (build vs run) - Pitfall 6: --batch-block-flush-interval default 1000 too big for <1000 block ranges - Pitfall 7: composite vs single PK wire format mismatch in db_out - Pitfall 8: --on-module-hash-mismatch flag for cursor reuse after .spkg changes - Clarify SUBSTREAMS_API_KEY (not _TOKEN) is the right env var Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
From T7.1 trial #3 finding: - substreams-sink-sql run signature is: <dsn> <manifest> [<range>] -e <endpoint> - Endpoint is -e/--endpoint flag, NOT positional - Module name positional but optional (auto-inferred from .spkg) - Fixed all 4 example commands in skill body
… postgresql:// T7.1 trial 4 finding: substreams-sink-sql v4.13.1 rejects postgresql:// DSN scheme. Accepts: psql, postgres, clickhouse, parquet. Update both DSN examples in skill to use psql:// and add the full accepted-schemes list.
There was a problem hiding this comment.
Pull request overview
Adds a new skill document (substreams-sink-deploy) to guide users through running and deploying Substreams sink binaries (SQL/files/PubSub/webhook/protojson/subgraph), focusing on operational setup details like DSNs, CLI argument order, cursor/reorg handling, and common pitfalls.
Changes:
- Introduces a new
substreams-sink-deployskill with decision tree + end-to-end operational workflows. - Documents SQL sink DSN scheme requirements and common runtime pitfalls (schema, cursors, reorgs, batching).
- Provides runnable command examples for multiple sink types plus a quick-reference “full example”.
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
There was a problem hiding this comment.
Pull request overview
Copilot reviewed 1 out of 1 changed files in this pull request and generated 1 comment.
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
There was a problem hiding this comment.
Pull request overview
Copilot reviewed 1 out of 1 changed files in this pull request and generated 5 comments.
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
There was a problem hiding this comment.
Pull request overview
Copilot reviewed 1 out of 1 changed files in this pull request and generated 3 comments.
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
…, add module_name to CLI signature
…abel, PubSub imports
There was a problem hiding this comment.
Pull request overview
Copilot reviewed 1 out of 1 changed files in this pull request and generated 3 comments.
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
…lush wording, files sink block range syntax
There was a problem hiding this comment.
Pull request overview
Copilot reviewed 1 out of 1 changed files in this pull request and generated 5 comments.
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
…oth sink and psql client)
There was a problem hiding this comment.
Pull request overview
Copilot reviewed 1 out of 1 changed files in this pull request and generated 4 comments.
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
There was a problem hiding this comment.
Pull request overview
Copilot reviewed 1 out of 1 changed files in this pull request and generated 2 comments.
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
…kg consistency, webhook state.json path, sales email Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
There was a problem hiding this comment.
Pull request overview
Copilot reviewed 1 out of 1 changed files in this pull request and generated 4 comments.
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
…leased Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
… fix module-hash-mismatch flag docs Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
There was a problem hiding this comment.
Pull request overview
Copilot reviewed 2 out of 2 changed files in this pull request and generated 2 comments.
Comments suppressed due to low confidence (1)
README.md:123
- The Plugin Structure tree was updated to include
substreams-sink-deploy/, but it still omits the existingskills/substreams-sink/directory. Since users rely on this tree to discover available skills, please addsubstreams-sink/here for completeness/accuracy.
└── skills/
├── substreams-dev/
│ ├── SKILL.md # Main skill content
│ └── references/ # Additional reference materials
│ ├── manifest-spec.md
│ ├── module-types.md
│ ├── networks.md
│ └── patterns.md
├── substreams-sink-deploy/
│ └── SKILL.md
├── substreams-sql/
│ ├── SKILL.md
│ └── references/
│ ├── clickhouse-patterns.md
│ └── database-changes.md
└── substreams-testing/
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
…tup, not required in schema.sql Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
There was a problem hiding this comment.
Pull request overview
Copilot reviewed 2 out of 2 changed files in this pull request and generated 2 comments.
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
…d substreams-sink to structure tree Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
There was a problem hiding this comment.
Pull request overview
Copilot reviewed 2 out of 2 changed files in this pull request and generated 1 comment.
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
…client, fix stale cursors comment Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
There was a problem hiding this comment.
Pull request overview
Copilot reviewed 2 out of 2 changed files in this pull request and generated 1 comment.
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
…ll to Available Skills section Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
There was a problem hiding this comment.
Pull request overview
Copilot reviewed 2 out of 2 changed files in this pull request and generated no new comments.
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
Summary
substreams-sink-deployskill for running and deploying Substreams sinks to SQL databasespsql://notpostgresql://), and discoverabilityTest plan
skills/substreams-sink-deploy/SKILL.mdloads correctly in Claude Codepsql://accepted bysubstreams-sink-sql v4.13.1🤖 Generated with Claude Code