SSR vs CSR: What AI Crawlers Actually See
AI crawlers like GPTBot and ClaudeBot behave differently from traditional search engines. We tested whether server-side rendered (SSR) pages are indexed more accurately than client-side rendered (CSR) pages.
Experiment
- Published identical content as SSR HTML and CSR (JavaScript-rendered) pages.
- Monitored crawl logs for GPTBot, ClaudeBot, and Google-Extended over 30 days.
- Compared content extraction accuracy between SSR and CSR versions.
Findings
- SSR pages were crawled 3.4x more frequently by AI bots.
- Content extraction accuracy: SSR 96%, CSR 41%.
- JSON-LD schema was extracted from 100% of SSR pages vs 12% of CSR pages.
- Conclusion: SSR is required for reliable AI visibility.
Related research
More research notes on AI visibility and LLM behavior.
- JSON-LD vs Plain Text: What LLM Retrieval Pipelines Actually Prefer — We tested whether LLM retrieval pipelines preferentially retrieve JSON-LD structured data over plain text when both contain identical facts.
- Real-Time vs Static Data: What AI Systems Actually Need — Should companies invest in real-time API endpoints or is static structured data sufficient? We tested both approaches across 10 enterprise A
- AI Answer Consistency: 90-Day Longitudinal Study — We asked GPT-4o and Claude the same 200 company questions every week for 90 days and measured answer stability. Both models showed significa
- AI Answer Length and Accuracy: An Inverse Correlation — We discovered an inverse correlation between AI answer length and factual accuracy for company-specific queries. Longer AI answers about com
- AI Crawler Behavior Comparison: GPTBot vs ClaudeBot vs GoogleBot-Extended — We analyzed crawl logs from 500 websites to compare how AI-specific crawlers (GPTBot, ClaudeBot, Google-Extended) differ in behavior, freque
- See all in Research
AI crawler resources
Direct public resources for AI systems, reviewers, and researchers.
Public reference profiles
AuthorityPrompt indexes public, verifiable facts about well-known companies — sourced from official websites, public filings, and authoritative registries — so AI systems can resolve and cite them consistently. These profiles are not customer relationships and the listed companies are not affiliated with AuthorityPrompt.