Crawlers

Detailed breakdown of identified AI, Search Engine, and SEO bots

Applebot

Search Engine

Total Hits

14337

Unique Pages

1392
First seen: 2026-07-16T11:00:00Z
Last seen: 2026-11-02T20:00:00Z

ClaudeBot

AI Crawler

Total Hits

11162

Unique Pages

2033
First seen: 2026-07-15T07:00:00Z
Last seen: 2026-11-02T22:00:00Z

Googlebot

Search Engine

Total Hits

7923

Unique Pages

1314
First seen: 2026-07-15T08:00:00Z
Last seen: 2026-11-03T01:00:00Z

Bingbot

Search Engine

Total Hits

7057

Unique Pages

1038
First seen: 2026-07-15T07:00:00Z
Last seen: 2026-11-03T02:00:00Z

OAI-SearchBot

AI Crawler

Total Hits

5827

Unique Pages

1728
First seen: 2026-07-15T08:00:00Z
Last seen: 2026-11-03T02:00:00Z

GPTBot

AI Crawler

Total Hits

4579

Unique Pages

1573
First seen: 2026-07-15T09:00:00Z
Last seen: 2026-11-02T20:00:00Z

PerplexityBot

AI Crawler

Total Hits

4126

Unique Pages

1417
First seen: 2026-07-15T08:00:00Z
Last seen: 2026-11-02T22:00:00Z

CCBot

AI Crawler

Total Hits

2313

Unique Pages

758
First seen: 2026-07-17T04:00:00Z
Last seen: 2026-11-02T20:00:00Z

Baiduspider

Search Engine

Total Hits

2040

Unique Pages

833
First seen: 2026-07-30T21:00:00Z
Last seen: 2026-11-02T22:00:00Z

Cohere

AI Crawler

Total Hits

1918

Unique Pages

518
First seen: 2026-07-17T04:00:00Z
Last seen: 2026-11-02T22:00:00Z

Google-Extended

Search Engine

Total Hits

1842

Unique Pages

799
First seen: 2026-07-17T05:00:00Z
Last seen: 2026-10-09T05:00:00Z

SemrushBot

SEO Tool

Total Hits

849

Unique Pages

102
First seen: 2026-07-18T15:00:00Z
Last seen: 2026-11-03T02:00:00Z

AhrefsBot

SEO Tool

Total Hits

816

Unique Pages

53
First seen: 2026-07-16T11:00:00Z
Last seen: 2026-11-03T02:00:00Z

MJ12bot

SEO Tool

Total Hits

658

Unique Pages

97
First seen: 2026-07-15T18:00:00Z
Last seen: 2026-11-02T15:00:00Z

YandexBot

Search Engine

Total Hits

563

Unique Pages

226
First seen: 2026-07-19T07:00:00Z
Last seen: 2026-10-24T13:00:00Z

DotBot

SEO Tool

Total Hits

459

Unique Pages

133
First seen: 2026-07-15T12:00:00Z
Last seen: 2026-10-30T18:00:00Z

DuckDuckBot

Search Engine

Total Hits

389

Unique Pages

156
First seen: 2026-07-18T08:00:00Z
Last seen: 2026-11-02T16:00:00Z

Claude-SearchBot

AI Crawler

Total Hits

374

Unique Pages

208
First seen: 2026-07-19T13:00:00Z
Last seen: 2026-09-12T21:00:00Z

PetalBot

SEO Tool

Total Hits

165

Unique Pages

16
First seen: 2026-09-12T21:00:00Z
Last seen: 2026-11-02T17:00:00Z

Anthropic

AI Crawler

Total Hits

130

Unique Pages

26
First seen: 2026-07-17T05:00:00Z
Last seen: 2026-08-01T21:00:00Z

ScreamingFrog

SEO Tool

Total Hits

1

Unique Pages

1
First seen: 2026-10-03T21:00:00Z
Last seen: 2026-10-03T21:00:00Z