Search Engine is a programme consisting of web crawling, web indexing and web searching for the information a user wants on the world wide web. That information may consists of querries related to web pages, web sites, music, software, images, videos or anything. Search engines follow algorithms to gather relevant information about the search term for a user. Search Engines basically follow three principles for a website, Web Crawling Web Indexing Web Searching Web Crawler - also know as web spider, web robot, ants, bots, worms, automatic indexers, is a programme or an automated script which searches for the information on the world wide web. The crawlers take the snap shot of the visited pages for the later indexing by the spiders and to provide the information quickly. The web crawler starts with a list of URLs to visit, called the seeds and identifies all the hyperlinks in the page and adds them to the list of URLs to visit. Web Indexing - is a process to collect, save and find fa...