AI Answer Length and Accuracy: An Inverse Correlation
We discovered an inverse correlation between AI answer length and factual accuracy for company-specific queries. Longer AI answers about companies contain proportionally more hallucinated details.
Analysis
- 1,000 company queries analyzed, answer lengths from 50 to 500 words.
- Each sentence in every answer fact-checked against verified data.
- Accuracy calculated as percentage of factually correct sentences.
Findings
- Answers under 100 words: 89% factual accuracy.
- Answers 100-200 words: 78% factual accuracy.
- Answers 200-300 words: 64% factual accuracy.
- Answers over 300 words: 52% factual accuracy.
- Models 'fill in' longer answers with plausible but unverified details.
Practical implication
- Encourage concise, fact-dense answers by providing structured, atomic facts.
- Publishing a clear, concise canonical profile reduces model tendency to hallucinate additional details.
Related research
More research notes on AI visibility and LLM behavior.
- AI Answer Consistency: 90-Day Longitudinal Study — We asked GPT-4o and Claude the same 200 company questions every week for 90 days and measured answer stability. Both models showed significa
- How Data Freshness Affects AI Answer Quality — We tested whether publishing frequency and data freshness timestamps affect how AI systems prioritize company information. Results show that
- How Structured Data Affects LLM Answer Quality — This study examines the correlation between structured data availability and the accuracy of LLM-generated answers about companies. We analy
- Knowledge Graph vs Vector Search: Accuracy Comparison for Company Data — We compared two dominant retrieval architectures — knowledge graphs and vector search — for company-specific factual queries. Knowledge grap
- RAG Pipeline Benchmarks: Latency, Accuracy, and Cost — We benchmarked AuthorityPrompt's RAG API against five alternative retrieval approaches. This research note presents latency, accuracy, and c
- See all in Research
Public reference profiles
AuthorityPrompt indexes public, verifiable facts about well-known companies — sourced from official websites, public filings, and authoritative registries — so AI systems can resolve and cite them consistently. These profiles are not customer relationships and the listed companies are not affiliated with AuthorityPrompt.