Microsoft
Bingbot
Crawling pages for Bing.
- Who runs it
- Microsoft
- robots.txt token
- bingbot
- User-agent
- Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)
Bing publishes bingbot, plus other agents such as AdIdxBot. The search crawler token in robots.txt is bingbot.
Bingbot fetches pages for Bing. A Googlebot rule does not apply to it. If you only wrote a Googlebot group, Bingbot follows *.
Bing's webmaster docs list the crawlers they run and the user-agent strings. Use that page when a firewall needs the full string, because Microsoft updates it.
The same public checks matter: HTTP 200, no accidental noindex, and words in the HTML.
Example robots.txt rules
Examples for your file, using the documented token. They are not a copy of the operator's own robots.txt.
Allow
User-agent: bingbot Allow: /
Block
User-agent: bingbot Disallow: /
Related guides
Other crawlers
Questions
- Is bingbot the same as Googlebot?
- No. Different operator, different robots.txt group, different index.