Noindex in robots.txt: why it fails and what actually hides SaaS pages from AI answers
Google never supported noindex in robots.txt, and a blocked URL hides the meta tag that would have worked. What to use instead, and how deindexing affects AI citations.