AI
Monday, March 30, 2026 5:30:00 PM
Apple Web Crawler
How Applebot and Apple crawlers shape visibility across Apple’s ecosystem
This blog explains how Apple’s web crawlers, including Applebot and Applebot-Extended, work across its ecosystem to surface content in Siri, Spotlight, and Safari. It outlines the different crawlers, their purposes—such as search indexing, feed updates, and AI training—and how enabling them can improve content visibility, traffic, and control over how content is used, particularly in generative AI.
Tuesday, March 3, 2026 5:30:00 PM
Perplexity's robots and crawlers
Research into Perplexity's approach to scraping web content
Find out how we classify Perplexity's crawler scrape web content.
Friday, February 13, 2026 5:30:00 PM
Meta's robots and crawlers
Research into Meta's approach to scraping web content
Find out how we classify Meta's crawlers and AI content scrapers.
Wednesday, January 28, 2026 5:45:00 PM
AI Is Eating the Content World. Now What?
3rd March 2026 | Recording
In this one-hour session, James will cover:
- How AI is reshaping content distribution and consumption
- The real risks - and the overlooked opportunities - for publishers
- Practical steps content creators and media businesses can take today to protect their business
- What "survival" actually looks like in an AI-driven content economy
If you work in publishing, media, or content, this session is built for you. You'll leave with a clear, practical playbook - and a better chance of staying relevant.