# CVision — https://www.cvisionapp.com # AI crawlers (GPTBot, ClaudeBot, PerplexityBot, OAI-SearchBot, Google-Extended, # etc.) are governed by the rules below via User-agent: * — they are welcome on # all public pages and only blocked from private, auth-gated routes. # # NO BLANK LINES BELOW THIS POINT, until the Sitemap line. # # RFC 9309 - the spec Google wrote and follows - says a group runs until the # next user-agent line or EOF, so blank lines inside it are harmless there. # The older 1994 draft says a blank line ENDS the record, and parsers that # still follow it (Python's stdlib robotparser among them) therefore threw # away every rule in this file: with a blank line after "User-agent: *" the # group was discarded entirely, and /dashboard, /hq-portal, /settings and # /login came back as crawlable. Comments are safe in both; blank lines are # not. Keep the group contiguous. User-agent: * # Public pages — index these Allow: /$ Allow: /try Allow: /how-ats-works Allow: /about Allow: /pricing Allow: /privacy Allow: /terms # The English tree. Same pages, /en prefix. Allow: /en # Private / user pages — do not index Disallow: /dashboard Disallow: /analysis/ Disallow: /history Disallow: /settings Disallow: /hq-portal Disallow: /payment/ Disallow: /login Disallow: /register Disallow: /forgot-password Disallow: /reset-password Sitemap: https://www.cvisionapp.com/sitemap.xml