device detection

Why preserving the original User-Agent matters

51Degrees

Wednesday, July 29, 2026 3:30:00 PM

Why preserving the original User-Agent matters

Lowercasing a User-Agent removes information that no detection engine can recover

Applications, proxies, and analytics platforms often lowercase or otherwise normalize User-Agent strings before they are processed. This blog explains why a User-Agent is structured data rather than ordinary text, what is lost when it is modified, and the best practice for keeping device detection accurate.

Naver's robots and crawlers

51Degrees

Tuesday, July 28, 2026 1:30:00 PM

Naver's robots and crawlers

Research into Naver's approach to scraping web content

This blog explains how Naver’s web crawlers, including Yeti, Ads-Naver, and Blueno, interact with website content. It outlines their different roles, the crawler usage values assigned to each, and how they affect content visibility across Naver’s search and services.

When is CTV not CTV?

51Degrees

Tuesday, July 7, 2026 1:30:00 PM

When is CTV not CTV?

Nearly 5% of inventory sold as CTV isn't CTV at all

What actually counts as connected TV? We checked more than 11 million OpenRTB impressions with Device Detection and found nearly 5% of inventory sold as CTV isn't CTV at all, mislabeling that could be costing advertisers close to $2 billion a year.

Apple model number lookup: A-code to iPhone and iPad

51Degrees

Tuesday, June 16, 2026 5:00:00 PM

Apple model number lookup: A-code to iPhone and iPad

Every A-code 51Degrees recognises, in one table.

Your iPhone or iPad has an AXXXX code printed on the back or buried in Settings. It tells you which model the device is, but only if you have the mapping. Here is the full A-code to device-name reference 51Degrees uses, along with a note on how Apple's three different identifiers fit together and where to find each one.

DuckDuckGo's Robots and Crawlers

51Degrees

Tuesday, June 16, 2026 1:30:00 PM

DuckDuckGo's Robots and Crawlers

Research into DuckDuckGo's approach to scraping web content

This blog explains how DuckDuckGo’s web crawlers, including DuckDuckBot and DuckAssistBot, interact with website content. It outlines their different roles, how they follow robots.txt directives, and the management of crawler access and content visibility.

Apple Web Crawler

51Degrees

Monday, March 30, 2026 5:30:00 PM

Apple Web Crawler

How Applebot and Apple crawlers shape visibility across Apple’s ecosystem

This blog explains how Apple’s web crawlers, including Applebot and Applebot-Extended, work across its ecosystem to surface content in Siri, Spotlight, and Safari. It outlines the different crawlers, their purposes—such as search indexing, feed updates, and AI training—and how enabling them can improve content visibility, traffic, and control over how content is used, particularly in generative AI.

Perplexity's robots and crawlers

51Degrees

Tuesday, March 3, 2026 5:30:00 PM

Perplexity's robots and crawlers

Research into Perplexity's approach to scraping web content

Find out how we classify Perplexity's AI web crawlers.

Automatic Data Updates With 51Degrees

51Degrees

Wednesday, February 18, 2026 5:30:00 PM

Automatic Data Updates With 51Degrees

Keep your detection engine accurate, synchronized, and maintenance-free with intelligent automatic data file updates.

Automatic data updates in the 51Degrees Pipeline API ensure device detection engines always use the latest data without manual intervention. With configurable polling, validation, and safe file replacement, this feature minimizes maintenance, prevents stale detections, and scales efficiently across single servers or large clusters.

Meta's robots and crawlers

51Degrees

Friday, February 13, 2026 5:30:00 PM

Meta's robots and crawlers

Research into Meta's approach to scraping web content

Find out how we classify Meta's crawlers and AI content scrapers.

User-Agents & Client-Hints

James Rosewell

Wednesday, January 28, 2026 11:00:00 AM

User-Agents & Client-Hints

Six Years On

User-Agent Client Hints were always going to be a "tax" on the web. In this article we recap the history, unpack the current state, and look to the future.