Tracking: v0.2.0 — schema, API parity, CLI, deployability

[haydenk]

Tracking issue for the v0.2.0 milestone.

Goal: Schema completeness, API parity, CLI consistency, deployability.

Builds on v0.1.0 by closing gaps between the documented schema/API surface and what's actually implemented, aligning CLI flags with the docs, and making the system straightforward to deploy.

Ordered in rough working sequence. Issues within a phase can be done in parallel.

Phase 1 — Lock down the ingest boundary first

Do these before mutating the schema — they reduce the risk of subsequent migrations silently drifting from the incoming data.

• CSV header layout is hardcoded and never validated against actual file headers #32 — CSV header layout is hardcoded and never validated against actual file headers
• Document lifecycle state transitions are not atomic (no transaction wrapping) #31 — Document lifecycle state transitions are not atomic (no transaction wrapping)

Phase 2 — Schema & ETL additions

Schema changes that downstream API work depends on.

• Reconcile esiid_documents table design with CLAUDE.md #20 — Reconcile esiid_documents table design with CLAUDE.md
• Parse and store publish_date from ERCOT filenames #21 — Parse and store publish_date from ERCOT filenames
• Add settlement_load_zone to the esiids schema and ETL #16 — Add settlement_load_zone to the esiids schema and ETL

Phase 3 — API endpoints

Depends on Phase 2 — the load_zone filter needs #16, and the direct-lookup endpoint benefits from stable schema.

• Implement or remove the load_zone search filter #15 — Implement or remove the load_zone search filter
• Add GET /esiid/{esiid} direct lookup endpoint #14 — Add GET /esiid/{esiid} direct lookup endpoint

Phase 4 — Downloader resilience

Independent track — can run in parallel with Phases 1–3.

• No retry logic for transient ERCOT API failures in the downloader #37 — No retry logic for transient ERCOT API failures in the downloader
• No disk space check before downloading ERCOT files #38 — No disk space check before downloading ERCOT files

Phase 5 — CLI & deployability

Align the surface and ship a deployable image. Do last so the Docker image and docs capture the final CLI shape.

• Align CLI flag names across binaries and documentation #19 — Align CLI flag names across binaries and documentation
• Refactor block_in_place and block_on pattern in ETL loader #18 — Refactor block_in_place and block_on pattern in ETL loader
• Add structured JSON logging for production deployments #17 — Add structured JSON logging for production deployments
• Add Dockerfile and docker-compose for local development and deployment #22 — Add Dockerfile and docker-compose for local development and deployment

---

Auto-closes when every linked issue is closed. Progress is tracked by GitHub via the task list above.