Skip to main content

Crawling vs Indexing

We do a lot of searches monthly, and we do that by putting the search term into the Google search box, and just on the press of the button we are displayed by a zillion search results based on the popularity of the searched term.

Have we ever thought how it happens. Just by entering the search terms we are displayed the highly accurate information. I have tried to mention the concept behind the Google Search Results, by comparing the Crawling and Indexing process of the Google Search Engine Bot.


There are basically three processes to present the search results to the visitors

  • Crawling the Website
  • Indexing the Website
  • Serving the Results


Website Crawling

Crawling in simple terms is the process of finding & adding the new and updated pages to the Google Index. Crawling is done by the Google's software, called as Google Bot (which is also known as the search engine spider or robot, or a bot). The Google's algorithm for crawling the site determines which sites to crawl, how many times, and how many pages from each site.

The crawler process starts with the list of the URL's, generated from the previous crawl and from the Google Sitemaps. The Googlebot visits each of these websites and it detects links on each page and adds them to its list of pages to crawl. The new sites, changes to existing sites, and dead links are noted and used to update the Google index.

It's an automated process, the crawling of the website, and has nothing to do with the payment to crawl the website more frequently.


Website Indexing

Indexing in simpler terms is mintaining list of things. In this aspect indexing means, compiling an index of words, and their location on each page, taken at the time of crawling the website by Google Bot. In addition to this, the Google Bot processes the information included in key content tags and attributes, such as Title tags and ALT attributes. Googlebot can process many content types, but not all.


The Search Results
Serving Results is the process where the Google returns the results to the query entered by the user, based on the matches with the indexed pages. The relevncy of the search result depends on a lot of factors. And based on those factors Google returns the search results.

In order for your site to rank well in search results pages, it's important to make sure that Google can crawl and index your site correctly.





Some Useful Links




Related Posts

Suggested Reading

Most Read SEO Articles

Comments

Popular posts from this blog

List of 100 Article Directories

An article is an essay or a research on a particular topic. Article provides a lot of exposure to your business and very high relevant traffic to your website. Other than providing the quality traffic, article submission has SEO benefits also, it gives a valuable back-link to the website. So here we go with the list of 100 Article Submission websites, "BEST 100 ARTICLE DIRECTORIES" S.No. ARTICLE DIRECTORY PR SUBMISSION PAGE STATUS 1 MAGPORTAL 7 Submit Article SIGN UP 2 EMEDIAWIRE 6 Submit Article SIGN UP 3 EZINEARTICLES 6 Submit Article SIGN UP 4 GOARTICLES 6 Submit Article SIGN UP 5 WEBPRONEWS 6 Submit Article SUBMIT 6 ARTICLEPOOL 6 Submit Article SIGN UP 7 MARKETINGSOURCE ARTICLES 5 Submit Article SUBMIT 8 ARTICLEMOTRON 5 Submit Article SIGN UP 9 ARTICLESON 5 Submit Article SIGN UP 10 ARTICLESBASE 5 Submit Article SIGN UP 11 BUZZLEARTICLES 5 Submit Article SIGN UP 12 ARTICLEALLEY 5 Submit Article SIGN UP 13 ARTICLE DASHBOARD 5 Submit Article SIGN UP 14 WEB-SOURCE 5 Submit A...

List of 100 Top SEO Forums

Forums are online communities which provides the users to hold discussions, ask/research (already posted) questions, on the world wide web. Generally speaking forums are another name for discussion boards, or message boards. They enables the users to share, discuss or put the questions based on the theme of the websites. Benefits of Forums There are several benefits for which the forums are used, It's an online community where the users of the websites, can interact with the other users, and exchange tips and place questions based on the theme of the website. They save the information posted, and makes it readily available for the others to read the post. The posts get to read again and again, and the user can post the reply to the already placed post. Forums also allow to increase traffic to your website through repeated visits, gain creditability & build relationship with visitors. It also acts as a kind of Direct Advertising, that increases the ROI. There are large number of...

Optimizing Your Website for Local Searches: A Local SEO Guide

Local SEO Guide In today's digital landscape, local businesses must prioritize their online presence to attract and retain local customers. One of the most effective strategies for achieving this is by optimizing your website for local searches. In this comprehensive guide, we will explore the key steps and best practices to boost your local SEO and ensure that your website ranks prominently in local search results. The topics covered in the local SEO guide are listed below,   Understanding Local SEO Keyword Research for Local SEO On-Page Optimization Techniques Website Localization Google My Business Optimization Local Link Building Strategies Mobile Optimization for Local Searches Online Reviews and Reputation Management Social Media for Local SEO Tracking and Measuring Local SEO Performance Please comment if you feel something is missing! Understanding Local SEO Local SEO refers to the practice of optimizing a website and online presence to increas...

How to create XML sitemap for your Blogger Blog Manually?

How to Create XML sitemap for your Blogger Blog Manually? Creating an XML sitemap for your Blogger blog can be done manually by following these steps: Open a text editor Open a plain text editor on your computer, such as Notepad (Windows) or TextEdit (Mac). Start the XML document Begin by typing the XML declaration at the top of the document: Add the root element Below the XML declaration, add the root element for the sitemap:     Add URL entries For each page of your blog, add a URL entry within the tags. Here's an example for a blog post: Replace "https://yourblog.blogspot.com/your-blog-post-url" with the actual URL of your blog post. Use the tag to specify the date of the last modification in the format YYYY-MM-DD. indicates how frequently the page is likely to change (e.g., "always," "hourly," "daily," "weekly," "monthly," "yearly," "never"). represents the priority of the page on a scal...

All About chatGPT and it's Uses for Online Marketing

What is chatGPT ChatGPT is a language model developed by OpenAI that is designed to converse with users in natural language. It uses artificial intelligence and machine learning to generate human-like responses to user input, based on its training on a vast amount of data from the internet. The "GPT" in ChatGPT stands for "Generative Pretrained Transformer," which refers to the architecture of the model. The transformer architecture is a type of neural network that has been shown to be highly effective at natural language processing tasks, such as language translation and text summarization. ChatGPT can understand and respond to a wide range of questions on different topics, including science, history, art, and more. It is designed to provide reliable and accurate answers to users, and it can learn from its interactions with users to improve its responses over time. ChatGPT is a powerful tool that can provide quick and easy access to information and answer...

Local SEO Guide

Local SEO Guide
The Local SEO Guide - the key steps and best practices to boost your local SEO and ensure that your website ranks prominently in local search results.