WWWHelper

Small Business Resource Center

Print This Page


Site Menu

FYI...

Google Adwords Complete Optimization Secrets Revealed
Google Adwords A Complete Guide To Optimization And Secrets Revealed:
Discover the hidden secrets of Google Adwords. Current Adwords users will triple their traffic at a quarter of the cost. New members will have the knowledge to set their ad up properly the first time. We are going to give you the secrets you need to set your ad up properly the first time. The Adw...

Build Competition-Crushing Keyword Lists
Google-Adword Keywords Tool for Building a Competition-Crushing Keyword Lists:
Whatever Your Online Activity, Keywords Are At The Heart of Your Business "How To Crush Your Competition: Create Bigger, Better, More Profitable Keyword Lists" Whatever your online business, keywords are at the heart of what you do. PPC Web Spy will not just save you hours of yo...

Xtreme Rankings Search Engine Optimization (SEO) Program
Xtreme Rankings Search Engine Optimization (SEO) Program:
Every internet marketer reaches a point when he or she is faced with a decision: Do you give up, or do you break through this barrier? Is this one of those times? Is Getting off of Adwords and into the organic listings with SEO you're goal? After all, getting to the first page of Google SOUNDS...

Discover The Best Keywords To Target On Your Website
Keyword Suggestion Program Will Suggest The Best Keywords To Target On Your Website:
The Secret Is In The List... The Keyword List! Discover The Best Keywords To Target On Your Website Over 80% of all online transactions begin with a keyword search. To compete, you need to target all the relevant keywords in your business niche. Rapidly Generate High Paying Adsense Ke...

Small Biz Articles Archive Category: SEO
 
Small Biz Articles Archive Menu
 
Articles Home ]   [ Ad Mgmt. ]   [ Affiliate Programs ]   [ Article Biz ]   [ Biz Ops ]   [ Blogging ]   [ eBooks ]   [ Economy ]   [ Home Business ]   [ Marketing ]   [ Newsletters ]   [ Online Business ]   [ Outsourcing ]   [ PLR ]   [ SEO ]   [ Web Consulting ]   [ Web Sites ]   [ Writing ]   [ All In Order ] 
 
Search Articles ]  ]   [ Add to Technorati Favorites ]   [ Subscribe To Raw XML file ] 
 

"How Search Engines Work - Web Spiders and Crawlers"


There are no comments shared for this Small Biz Articles Archive.

Click here to be the first to share your comments for this Small Biz Articles Archive.

Monday, March 15, 2010

Perhaps it's best to start off here by making a slight, but important distinction about Search Engines, and that is that generally when people mention the term Internet Search Engines, what they're actually are referring to - at least in this day and age - are World Wide Web Search Engines. This is because now, the WWW has become, by far, the biggest part of the Internet and so most searches now are limited to the "Web".

So, ultimately, it's these search engines that find and make your website visible to Web users and prospective clients. It is therefore very helpful for us to know, at least in principle, the inner workings of these engines, and how they go about finding and presenting information to Web users searching for information.

The search for what the user has queried begins with special software bots (or robots) called spiders which are basically employed by the search engines to go out and find the relevant information across the millions of websites - and then come back and build lists of the related words they have found.

This procedure is called Web Crawling, and it's a rather involved and intense process of building and maintaining lists of related words from a huge number of pages.

So essentially a spider is an automated program that fetches Web Pages automatically and feeds this information to the engine.

But where does it all begin? The spider's journey actually starts "top down" - so from the most popular and most heavily visited pages and sites, and works its way down to other sites and servers using the links present in these pages.

So, when you submit website pages to an engine, their spider will come along and index your site. It will "read" the content, including any Meta tag data and then continue on and follow any links out of the site to other pages. This data is then passed by the spider to a central collection point where this data is all indexed. Any sites that have been found via your links will also be indexed.

Therefore, when you type in a search term in a search engine for it locate relevant information for you, it actually searches its index for the information, not the Web.

The spiders will sporadically return to these sites to check for any updates or information that may have changed and the frequency with which this occurs is dependent on the arbitrator of the particular engine.

Different Search Engines like Lycos, Google or Excite use different algorithms to determine the ranking of web pages, each using a slightly different set of criteria to evaluate "relevancy" in the indices, which is why, typically, these search engines will return different search results for the same keyword term.

However, fundamentally, a search engine's algorithm is programmed to inspect for the frequency of a particular keyword, and its location. It also scans for what is known as spamdexing, or artificially stuffed keywords in a web page.

The relationship between pages, or the way in which pages are linked is then analysed by the algorithms, and this enables the search engine to determine whether the keywords in the linked pages have relevancy and are similar to the keywords that were on the original web page, as well as determining what the page is about.

Provided By: George Vlismas
George Vlismas is an online business mentor and entrepreneur who specializes in helping you, and other serious-minded entrepreneurs, use internet marketing to start, build, promote and expand your home based online businesses and create multiple, passive income streams.
Website Address: georgevlismas.com

This Article is a Private Label Rights (PLR) Article and you may freely have a copy on your web site provided you keep the above provided by signature intact (In content advertisement not required).

This Small Biz Articles Archive Entry Viewed 3,071 Times
The PermaLink for this Small Biz Articles Archive is:
How Search Engines Work - Web Spiders and Crawlers


 
Small Biz Articles Archive Menu
 
Articles Home ]   [ Ad Mgmt. ]   [ Affiliate Programs ]   [ Article Biz ]   [ Biz Ops ]   [ Blogging ]   [ eBooks ]   [ Economy ]   [ Home Business ]   [ Marketing ]   [ Newsletters ]   [ Online Business ]   [ Outsourcing ]   [ PLR ]   [ SEO ]   [ Web Consulting ]   [ Web Sites ]   [ Writing ]   [ All In Order ] 
 
Search Articles ]  ]   [ Add to Technorati Favorites ]   [ Subscribe To Raw XML file ] 
Go To Top Of Page