Skip to main content

Crawling vs Indexing

We do a lot of searches monthly, and we do that by putting the search term into the Google search box, and just on the press of the button we are displayed by a zillion search results based on the popularity of the searched term.

Have we ever thought how it happens. Just by entering the search terms we are displayed the highly accurate information. I have tried to mention the concept behind the Google Search Results, by comparing the Crawling and Indexing process of the Google Search Engine Bot.


There are basically three processes to present the search results to the visitors

  • Crawling the Website
  • Indexing the Website
  • Serving the Results


Website Crawling

Crawling in simple terms is the process of finding & adding the new and updated pages to the Google Index. Crawling is done by the Google's software, called as Google Bot (which is also known as the search engine spider or robot, or a bot). The Google's algorithm for crawling the site determines which sites to crawl, how many times, and how many pages from each site.

The crawler process starts with the list of the URL's, generated from the previous crawl and from the Google Sitemaps. The Googlebot visits each of these websites and it detects links on each page and adds them to its list of pages to crawl. The new sites, changes to existing sites, and dead links are noted and used to update the Google index.

It's an automated process, the crawling of the website, and has nothing to do with the payment to crawl the website more frequently.


Website Indexing

Indexing in simpler terms is mintaining list of things. In this aspect indexing means, compiling an index of words, and their location on each page, taken at the time of crawling the website by Google Bot. In addition to this, the Google Bot processes the information included in key content tags and attributes, such as Title tags and ALT attributes. Googlebot can process many content types, but not all.


The Search Results
Serving Results is the process where the Google returns the results to the query entered by the user, based on the matches with the indexed pages. The relevncy of the search result depends on a lot of factors. And based on those factors Google returns the search results.

In order for your site to rank well in search results pages, it's important to make sure that Google can crawl and index your site correctly.





Some Useful Links




Related Posts

Suggested Reading

Most Read SEO Articles

Comments

Popular posts from this blog

List of 100 Article Directories

An article is an essay or a research on a particular topic. Article provides a lot of exposure to your business and very high relevant traffic to your website. Other than providing the quality traffic, article submission has SEO benefits also, it gives a valuable back-link to the website. So here we go with the list of 100 Article Submission websites, "BEST 100 ARTICLE DIRECTORIES" S.No. ARTICLE DIRECTORY PR SUBMISSION PAGE STATUS 1 MAGPORTAL 7 Submit Article SIGN UP 2 EMEDIAWIRE 6 Submit Article SIGN UP 3 EZINEARTICLES 6 Submit Article SIGN UP 4 GOARTICLES 6 Submit Article SIGN UP 5 WEBPRONEWS 6 Submit Article SUBMIT 6 ARTICLEPOOL 6 Submit Article SIGN UP 7 MARKETINGSOURCE ARTICLES 5 Submit Article SUBMIT 8 ARTICLEMOTRON 5 Submit Article SIGN UP 9 ARTICLESON 5 Submit Article SIGN UP 10 ARTICLESBASE 5 Submit Article SIGN UP 11 BUZZLEARTICLES 5 Submit Article SIGN UP 12 ARTICLEALLEY 5 Submit Article SIGN UP 13 ARTICLE DASHBOARD 5 Submit Article SIGN UP 14 WEB-SOURCE 5 Submit A

Optimizing Your Website for Local Searches: A Local SEO Guide

Local SEO Guide In today's digital landscape, local businesses must prioritize their online presence to attract and retain local customers. One of the most effective strategies for achieving this is by optimizing your website for local searches. In this comprehensive guide, we will explore the key steps and best practices to boost your local SEO and ensure that your website ranks prominently in local search results. The topics covered in the local SEO guide are listed below,   Understanding Local SEO Keyword Research for Local SEO On-Page Optimization Techniques Website Localization Google My Business Optimization Local Link Building Strategies Mobile Optimization for Local Searches Online Reviews and Reputation Management Social Media for Local SEO Tracking and Measuring Local SEO Performance Please comment if you feel something is missing! Understanding Local SEO Local SEO refers to the practice of optimizing a website and online presence to increas

Google Redesigns Gmail

Google has redesigned Gmail, which was launched in the year 2004 and remained in beta version till 2009. The new redesign is not the only thing Google is embarking on, rather it's a series of interface updates to help strip out unnecessary clutter and make Gmail as beautiful as it is powerful. What's New ? As per Google Blog - To start things off, Gmail has two new themes for you to try out as a sort of sneak peek. There is a "Preview” and “Preview (Dense)” themes in the Themes tab in Gmail Settings. The idea of two themes is to accommodate different screen sizes and user preferences, but until then you can pick the information density that you prefer. Here’s what one of the new themes currently looks like: And in conversation view:   Look out for these and other new features over the next few months. In the meantime, try out the new themes as a preview of the future of Gmail and you can send your feedback to Google about your experience with the new look

How to create XML sitemap for your Blogger Blog Manually?

How to Create XML sitemap for your Blogger Blog Manually? Creating an XML sitemap for your Blogger blog can be done manually by following these steps: Open a text editor Open a plain text editor on your computer, such as Notepad (Windows) or TextEdit (Mac). Start the XML document Begin by typing the XML declaration at the top of the document: Add the root element Below the XML declaration, add the root element for the sitemap:     Add URL entries For each page of your blog, add a URL entry within the tags. Here's an example for a blog post: Replace "https://yourblog.blogspot.com/your-blog-post-url" with the actual URL of your blog post. Use the tag to specify the date of the last modification in the format YYYY-MM-DD. indicates how frequently the page is likely to change (e.g., "always," "hourly," "daily," "weekly," "monthly," "yearly," "never"). represents the priority of the page on a scal

Google Getting More Real With Its ‘Real Time’ Search

Google launched a real time search engine, specifically dedicated to the searches made in the real time. Get the fun started here www.google.com/realtime You can use geographic refinements to find updates and news that's happening right near you or in the area of your choice. You can also follow a conversation by browsing a full timeline of tweets. Adding to the Google Real Time features, you can now create an alert specifically for "updates" to get an email the moment a topic of interest shows up on Twitter or other short-form services, in Google Alerts.   Currently the Google Real Time Search and updates are available globally in 40 languages, and the geographic refinements and conversations views are available in English, Japanese, Russian and Spanish.

Local SEO Guide

Local SEO Guide
The Local SEO Guide - the key steps and best practices to boost your local SEO and ensure that your website ranks prominently in local search results.