User-agent: * Allow: / # The signed-in app is deliberately NOT disallowed here. Those routes serve app.html, which # carries , and a crawler has to be allowed to # fetch a page in order to see that. Blocking them instead left Search Console reporting # "Blocked by robots.txt" — discovered, never read, never cleanly excluded. Allow + noindex is # the combination that actually keeps them out of the index. # /api/* is a proxy to the gateway and the installer endpoints — nothing to index, and # crawling it costs us real upstream requests, so this one stays blocked. Disallow: /api/ Sitemap: https://klaatai.com/sitemap.xml