PROFESSIONALLY OPTIMIZED WEBSITES STARTING AT $995
Our team of SEO Web Design gurus are standing by to assist you achieve your online marketing goals.

+1-971-599-3330

REQUEST QUOTE
SEO Web Design, LLC aims to improve business by delivering effective solutions based on innovative technologies and professional designs. Discover the variety of services we offer and convince yourself on the basis of the latest works that we've done. We love building fresh, unique and usable websites optimized specifically for your niche.

Responsive Web Design

SEO / SEM / Social Media

Conversion Rate Optimization

Email Marketing

Online Presence Analysis

Web Hosting
Top
SEO Web Design, LLC / SEO  / Bing Webmaster Tools gets a new robots.txt tester

Bing Webmaster Tools gets a new robots.txt tester

Bing has added a new feature to the new Bing Webmaster Tools[1]: a robots.txt tester. This is a feature Bing had in the tool prior to 2009 but dropped supporting it for the past ten-years or so. Now it is back and better.

Where can I access it? You can access the new robots.txt tester within the new Bing Webmaster tools over here[2]. From there you can enter a URL to see how BingBot will fetch the URL.

What does it look like? Below is a screenshot of the tool. Enter a URL, test it with BingBot and Bing’s Ad bot and also see how the robots.txt file differs from HTTP to HTTPS:

More details. The Bing help document[3] says that this “Robots.txt Tester helps Webmasters to analyze their robots.txt file and highlight the issues that would prevent them from getting optimally crawled by Bing and other robots.”

Fabrice Canal from the Bing team told us[4], “We resurrected and enhanced our old robots.txt tester.” Canal explained that this was a feature they had many years ago that the company brought back to life and made better.

Google also has a similar tool, you can learn more about it over here[5].

Why we care. Now you can see how BingBot sees your content. If you need to troubleshoot an indexing or ranking issue with Bing, this is one of the tools you can add to your toolkit to see how Bing can access your pages.


About The Author

Barry Schwartz a Contributing Editor to Search Engine Land and a member of the programming team for SMX events. He owns RustyBrick[6], a NY based web consulting firm. He also runs Search Engine Roundtable[7], a popular search blog on very advanced SEM topics. Barry’s personal blog is named Cartoon Barry[8] and he can be followed on Twitter here.

References

  1. ^ new Bing Webmaster Tools (searchengineland.com)
  2. ^ over here (www.bing.com)
  3. ^ document (www.bing.com)
  4. ^ told us (twitter.com)
  5. ^ over here (support.google.com)
  6. ^ RustyBrick (www.rustybrick.com)
  7. ^ Search Engine Roundtable (www.seroundtable.com)
  8. ^ Cartoon Barry (www.barryschwartz.org)

Powered by WPeMatico

[email protected]

Search Engine Land is the leading industry source for daily, must-read news and in-depth analysis about search engine technology.

No Comments

Sorry, the comment form is closed at this time.