Scrapalot Blog https://scrapalot.app/blog Notes on research tooling, retrieval, and reading with an AI that cites its sources. en Your site is probably invisible to AI crawlers https://scrapalot.app/blog/invisible-to-ai-crawlers https://scrapalot.app/blog/invisible-to-ai-crawlers Google renders JavaScript. GPTBot, ClaudeBot and PerplexityBot do not. If your marketing pages are a single-page app, the assistants people now ask for recommendations cannot read a word of them. Wed, 26 Aug 2026 00:00:00 GMT Scrapalot