We're sharing our Verified Bots Directory with the world, including realtime stats from our network. Interestingly, AI now amounts to 35.4% of bot traffic. GPTBot is the most prolific and most frequently impersonated, with actors trying to pretend they're ChatGPT when crawling.
Introducing Vercel Bots Directory. A public directory of verified bots on the web: • AI crawlers & assistants • SEO & search bots • Webhook traffic • Preview / fetch bots Powers Vercel Bot Protection to allow trusted automation and block bad actors. bots.fyi