Robots.txt Tip From Bing: Include All Relevant Directives If You Have A Bingbot Section
Frédéric Dubut, a senior program manager at Microsoft working on Bing Search, said on Twitter Wednesday that when you create a specific section in your robots.txt file for its Bingbot crawler, you should make sure to list all the default directives in that section. “If you create a section for Bingbot specifically, all the default directives will [...]