Skip to main content

Crawling vs Indexing

We do a lot of searches monthly, and we do that by putting the search term into the Google search box, and just on the press of the button we are displayed by a zillion search results based on the popularity of the searched term.

Have we ever thought how it happens. Just by entering the search terms we are displayed the highly accurate information. I have tried to mention the concept behind the Google Search Results, by comparing the Crawling and Indexing process of the Google Search Engine Bot.


There are basically three processes to present the search results to the visitors

  • Crawling the Website
  • Indexing the Website
  • Serving the Results


Website Crawling

Crawling in simple terms is the process of finding & adding the new and updated pages to the Google Index. Crawling is done by the Google's software, called as Google Bot (which is also known as the search engine spider or robot, or a bot). The Google's algorithm for crawling the site determines which sites to crawl, how many times, and how many pages from each site.

The crawler process starts with the list of the URL's, generated from the previous crawl and from the Google Sitemaps. The Googlebot visits each of these websites and it detects links on each page and adds them to its list of pages to crawl. The new sites, changes to existing sites, and dead links are noted and used to update the Google index.

It's an automated process, the crawling of the website, and has nothing to do with the payment to crawl the website more frequently.


Website Indexing

Indexing in simpler terms is mintaining list of things. In this aspect indexing means, compiling an index of words, and their location on each page, taken at the time of crawling the website by Google Bot. In addition to this, the Google Bot processes the information included in key content tags and attributes, such as Title tags and ALT attributes. Googlebot can process many content types, but not all.


The Search Results
Serving Results is the process where the Google returns the results to the query entered by the user, based on the matches with the indexed pages. The relevncy of the search result depends on a lot of factors. And based on those factors Google returns the search results.

In order for your site to rank well in search results pages, it's important to make sure that Google can crawl and index your site correctly.





Some Useful Links




Related Posts

Suggested Reading

Most Read SEO Articles

Comments

Popular posts from this blog

List of 100 Article Directories

An article is an essay or a research on a particular topic. Article provides a lot of exposure to your business and very high relevant traffic to your website. Other than providing the quality traffic, article submission has SEO benefits also, it gives a valuable back-link to the website. So here we go with the list of 100 Article Submission websites, "BEST 100 ARTICLE DIRECTORIES" S.No. ARTICLE DIRECTORY PR SUBMISSION PAGE STATUS 1 MAGPORTAL 7 Submit Article SIGN UP 2 EMEDIAWIRE 6 Submit Article SIGN UP 3 EZINEARTICLES 6 Submit Article SIGN UP 4 GOARTICLES 6 Submit Article SIGN UP 5 WEBPRONEWS 6 Submit Article SUBMIT 6 ARTICLEPOOL 6 Submit Article SIGN UP 7 MARKETINGSOURCE ARTICLES 5 Submit Article SUBMIT 8 ARTICLEMOTRON 5 Submit Article SIGN UP 9 ARTICLESON 5 Submit Article SIGN UP 10 ARTICLESBASE 5 Submit Article SIGN UP 11 BUZZLEARTICLES 5 Submit Article SIGN UP 12 ARTICLEALLEY 5 Submit Article SIGN UP 13 ARTICLE DASHBOARD 5 Submit Article SIGN UP 14 WEB-SOURCE 5 Submit A

Optimizing Your Website for Local Searches: A Local SEO Guide

Local SEO Guide In today's digital landscape, local businesses must prioritize their online presence to attract and retain local customers. One of the most effective strategies for achieving this is by optimizing your website for local searches. In this comprehensive guide, we will explore the key steps and best practices to boost your local SEO and ensure that your website ranks prominently in local search results. The topics covered in the local SEO guide are listed below,   Understanding Local SEO Keyword Research for Local SEO On-Page Optimization Techniques Website Localization Google My Business Optimization Local Link Building Strategies Mobile Optimization for Local Searches Online Reviews and Reputation Management Social Media for Local SEO Tracking and Measuring Local SEO Performance Please comment if you feel something is missing! Understanding Local SEO Local SEO refers to the practice of optimizing a website and online presence to increas

How to create XML sitemap for your Blogger Blog Manually?

How to Create XML sitemap for your Blogger Blog Manually? Creating an XML sitemap for your Blogger blog can be done manually by following these steps: Open a text editor Open a plain text editor on your computer, such as Notepad (Windows) or TextEdit (Mac). Start the XML document Begin by typing the XML declaration at the top of the document: Add the root element Below the XML declaration, add the root element for the sitemap:     Add URL entries For each page of your blog, add a URL entry within the tags. Here's an example for a blog post: Replace "https://yourblog.blogspot.com/your-blog-post-url" with the actual URL of your blog post. Use the tag to specify the date of the last modification in the format YYYY-MM-DD. indicates how frequently the page is likely to change (e.g., "always," "hourly," "daily," "weekly," "monthly," "yearly," "never"). represents the priority of the page on a scal

List of 100 Top SEO Forums

Forums are online communities which provides the users to hold discussions, ask/research (already posted) questions, on the world wide web. Generally speaking forums are another name for discussion boards, or message boards. They enables the users to share, discuss or put the questions based on the theme of the websites. Benefits of Forums There are several benefits for which the forums are used, It's an online community where the users of the websites, can interact with the other users, and exchange tips and place questions based on the theme of the website. They save the information posted, and makes it readily available for the others to read the post. The posts get to read again and again, and the user can post the reply to the already placed post. Forums also allow to increase traffic to your website through repeated visits, gain creditability & build relationship with visitors. It also acts as a kind of Direct Advertising, that increases the ROI. There are large number of

Contact Us

SEO Blog will be delighted to provide any sort of web marketing assistance. Contact us for all your SEO related queries at, tusharvickkie (at the rate) gmail (dot) com Remove spaces and braces with the respective symbol in order to contact to SEO Blog. We love to hear from you.

Local SEO Guide

Local SEO Guide
The Local SEO Guide - the key steps and best practices to boost your local SEO and ensure that your website ranks prominently in local search results.