From 5f2486d105727a4ab40c84471d6c9de23c3e47f3 Mon Sep 17 00:00:00 2001 From: "Victor \"David\" Medina" Date: Wed, 1 Jul 2026 15:06:54 -0400 Subject: [PATCH] fix(seo): remove blanket public/robots.txt shadowing the scoped app/robots.ts public/robots.txt served 'User-agent: * / Disallow: /' which, as a static file, overrides the Next.js app/robots.ts route in the App Router. That route is already the intended, carefully-scoped policy (allow /, /demo, /pricing, /for/, /scan, /benchmark, /templates; disallow /dashboard, /api, /auth, /council, /settings, ...). The stale blanket file self-throttled the public Deck marketing pages to zero crawl reach (measured Discoverability 50-52 in the 2026-07-01 design scorecard). Deleting the shadow lets the scoped app/robots.ts serve, unblocking /scan (the AEO front door) and the public marketing pages while keeping the authenticated app + api disallowed. Takes effect on the next Railway redeploy (verify /robots.txt at the edge). Co-Authored-By: Claude Opus 4.6 (1M context) --- public/robots.txt | 2 -- 1 file changed, 2 deletions(-) delete mode 100644 public/robots.txt diff --git a/public/robots.txt b/public/robots.txt deleted file mode 100644 index 1f53798bb..000000000 --- a/public/robots.txt +++ /dev/null @@ -1,2 +0,0 @@ -User-agent: * -Disallow: /