Last week, Bing announced that it has added a robots.txt tester, which can be found in its Webmaster Tools. The tester can help SEOs highlight issues that could stop Bing from optimal crawling. As a webmaster, you can submit a URL to the tool in order to check the robots.txt file to see if it [...]
A new feature has been added to the new Bing Webmaster Tools - a robots.txt tester. You can take the tester for a ride over here. This feature was added by Bing back in 2009, but was dropped. Now, it has officially returned. What does the Tester do? According to Bing, it will analyze Webmaster's [...]
According to a report from the Wall Street Journal, a Google crawler has been adding products to e-commerce site shopping carts. Apparently, there have been complaints by sellers about a serial cart abandoner named John Smith. But it turns out that the abandoner is actually a Google bot. A spokesperson from Google said that i [...]
“Often, I see JavaScript being blamed when the problem is something else,” search developer advocate at Google,Martin Splitt, cited as the underlying issue behind many of the site errors he has run across. During the crawling and indexing session of Live with Search Engine Land, Splitt talked about the most typical JavaScript-related issues that can hurt [...]
The groundwork for search engines' ability to rank well is the crawling and indexing processes of websites. Crawling and indexing are usually overlooked or misunderstood, despite its importance of fundamental aspects. During the crawling and indexing session of Live with Search Engine Land, Martin Splitt, search developer advocate at Google, explained these two processes using [...]
It's very important to optimize your Shopify store for Google, Bing and other search engines if you want potential customers to find your site. A number of the search engine optimization tenents are based on providing users with a good, positive experience. The easier it is to discover and use your Shopify store, the higher [...]
The IRS has revised its Free File agreement with online tax return software providers, which will require them to allow their Free File landing pages to be indexed by search engines and backing out of its pledge not to enter the e-file service marketplace. This news was reported on December 30. By using robot directives strategically, [...]
Screaming Frog, a search marketing firm, has released version 12.0 of its popular SEO Spider tool on October 22. In this update, you'll find PageSpeed Insights integration, auto-saves for database storage mode and a customizable GUI, along with other improvements. Website crawler tools are a valuable resource for analyzing sites, understanding how search engine crawlers navigate [...]
In an announcement made by Google, beginning in December, the company is going to update its user agent to represent the version of Chrome that GoogleBot is running. It is important to update any code you have that may look at the user agent of GoogleBot to suggest this change going forward. After the Evergreen GoogleBot [...]
In an announcement made September 27, people who use Yoast SEO are going to be opted into all of its snippet features by default. The update that contains this change, version 12.2, will roll out on October 1. A few days before, on September 24, Google announced new snippet settings to provide site owners some options that [...]