# witted.com User-agent: * Allow: / # AI / answer engines — explicitly allowed so Witted can be surfaced and cited # in AI search (ChatGPT, Perplexity, Google AI Overviews, Claude). Flip any of # these to "Disallow: /" if Witted decides to opt a given crawler out. User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: / Sitemap: https://witted.com/sitemap-index.xml # The per-opening /projects pages are server-rendered, so they are not in the # build-time sitemap index. robots.txt permits several Sitemap lines; this one is # generated at request time from the current openings snapshot. Sitemap: https://witted.com/sitemap-projects.xml