X-Robots-Tag for SPA routes
Robots meta in HTML is good, but middleware headers are better for route-based protection.
X-Robots-Tag helps you noindex whole prefixes consistently.
Recommended rules
Why it matters
- It prevents edge cases where a crawler reaches a SPA route and indexes an empty shell or private UI states.
Related articles
More from the AuthorityPrompt blog.
- What to noindex in a Hybrid SPA + SSR Site — Noindex rules for hybrid sites: app routes, parameterized filters, internal search, and private dashboards. Keep public content clean and ca
- Collection Pages and Filters: index or noindex? — Index hubs and curated categories. Noindex parameterized filters and internal search. Use canonicals to keep crawl paths clean at scale.
- LLM Retrieval: Why Duplicates Hurt — Duplicate content splits authority and increases the chance retrieval selects stale pages. Canonical rules and noindex filters keep catalogs
- Report Pages vs Blog Posts: What to Index — Index stable artifacts (reports, definitions, methodologies). Noindex internal dashboards and parameterized views. Scale the corpus with rep
- Why Canonical Is Not Optional for LLM-Facing Pages — Duplicate URLs split authority and confuse retrieval. Canonical + redirects + noindex rules are required infrastructure for reliable AI-faci
- See all in Blog
Public reference profiles
AuthorityPrompt indexes public, verifiable facts about well-known companies — sourced from official websites, public filings, and authoritative registries — so AI systems can resolve and cite them consistently. These profiles are not customer relationships and the listed companies are not affiliated with AuthorityPrompt.