fbpx

Category: Site Crawl

Understanding Googlebot: How the Search Crawler Indexes and Ranks Pages

By Scott Davenport | August 18, 2023 | Google Index,  Site Crawl

Getting your website properly indexed by Google is crucial for achieving high search engine rankings and visibility. The Google index is the giant database containing all the webpages that Google knows about and can potentially rank and display in search results. If your pages aren’t in Google’s index, there’s no chance of them appearing for …

Understanding Googlebot: How the Search Crawler Indexes and Ranks Pages Read More »

crab, sea, pliers-950463.jpg

Does Google Crawl URLs In Structured Data?

By Scott Davenport | July 21, 2022 | Crawling & Indexing,  Crawling & Robots,  Site Crawl,  Structured Data

Being able to get your links discovered, crawled and indexed by Google is important to your SEO, and can ultimately be advantageous because if one URL gets crawled, then more pages can get crawled on your website. In an episode of SEO Office Hours, John Mueller spoke up about whether or not Google used links …

Does Google Crawl URLs In Structured Data? Read More »

Covering Crawl Budget

By Scott Davenport | September 24, 2021 | Crawl Budget,  Crawling & Indexing,  Site Crawl

In this episode of Whiteboard Friday, Tom discusses the SEO concept of crawl budge. Crawl budget is the number of pages that Googlebot crawls and indexes on any given website, and also determines how often the most important page of that site gets crawled and how often an in-depth crawl is executed. Google has only …

Covering Crawl Budget Read More »

Technical Tips: How to Identify Critical Crawler Issues

By Scott Davenport | March 16, 2021 | Crawling & Indexing,  Site Crawl

With countless crawler warnings, you want to be able to filter out only the important ones….but how? On this episode of Technical Tips, Dr. Pete walks you through his method for identifying the most important site issues so you can fix them with ease!

Enterprise Site Crawl Management & Staying Ahead of the Google Algorithm

By Scott Davenport | March 8, 2021 | Algorithm,  Google,  Site Crawl

Are you preparing for the Core Web Vitals and mobile-first index transitions in a few months? What steps should you take in order to assess the impact of algorithm updates? Check out this Search Engine Journal video and find out!