WWWHelper

Small Business Resource Center

Print This Page


Site Menu

FYI...

AdlandPro
Review of AdlandPro the Free Online Marketing and Promotion Service:
Interested in free promotion, free advertising, marketing or networking? Then AdLandPro is the right service for you. AdLandPro has been offering free and paid advertising services to small businesses since 1996. AdLandPro has the most complete and most affordable advertising solutions for small b...

Dragon Naturally Speaking Voice Recognition Software
Dragon Naturally Speaking Voice Recognition Software gives small business users and PC users the power to create documents, reports, e-mails and more all by speaking:
Dragon Naturally Speaking Voice Recognition Software Dragon Naturally Speaking 9 is a speech recognition software program that makes it easy to talk to your computer and dictate to it. It recognizes your speech patterns and is compatible with most if not all computer applications. It adds a ...

Get Google Ads For Free System By Dr. Jon Cohen II, MD
Review Of The Get Google Ads Free Program Which Teaches You How You Can Advertise On Google Adwords, Or Any PPC, For Zero Cost:
Get Google Ads Free teaches you how you can advertise on Google AdWords (or any PPC) for ZERO cost. The author, Dr. Jon Cohen II, MD, says that he has achieved more that $87 million in free ads since he began this process, and over $12 million of that in the last year alone. This intrigued me. A...

aWeber
Review of aWeber Autoresponder, List Management and Newsletter Service:
How it Works: aWeber is a hosted subscription list management solution. Their 3rd party system allows you to manage huge subscriber lists. Their service can best be described by what their service provides. The ability to follow up with visitors to your...

Small Biz Articles Archive Category: SEO
 
Small Biz Articles Archive Menu
 
Articles Home ]   [ Ad Mgmt. ]   [ Affiliate Programs ]   [ Article Biz ]   [ Biz Ops ]   [ Blogging ]   [ eBooks ]   [ Economy ]   [ Home Business ]   [ Marketing ]   [ Newsletters ]   [ Online Business ]   [ Outsourcing ]   [ PLR ]   [ SEO ]   [ Web Consulting ]   [ Web Sites ]   [ Writing ]   [ All In Order ] 
 
Search Articles ]  ]   [ Add to Technorati Favorites ]   [ Subscribe To Raw XML file ] 
 

"How Search Engines Work - Web Spiders and Crawlers"


There are no comments shared for this Small Biz Articles Archive.

Click here to be the first to share your comments for this Small Biz Articles Archive.

Monday, March 15, 2010

Perhaps it's best to start off here by making a slight, but important distinction about Search Engines, and that is that generally when people mention the term Internet Search Engines, what they're actually are referring to - at least in this day and age - are World Wide Web Search Engines. This is because now, the WWW has become, by far, the biggest part of the Internet and so most searches now are limited to the "Web".

So, ultimately, it's these search engines that find and make your website visible to Web users and prospective clients. It is therefore very helpful for us to know, at least in principle, the inner workings of these engines, and how they go about finding and presenting information to Web users searching for information.

The search for what the user has queried begins with special software bots (or robots) called spiders which are basically employed by the search engines to go out and find the relevant information across the millions of websites - and then come back and build lists of the related words they have found.

This procedure is called Web Crawling, and it's a rather involved and intense process of building and maintaining lists of related words from a huge number of pages.

So essentially a spider is an automated program that fetches Web Pages automatically and feeds this information to the engine.

But where does it all begin? The spider's journey actually starts "top down" - so from the most popular and most heavily visited pages and sites, and works its way down to other sites and servers using the links present in these pages.

So, when you submit website pages to an engine, their spider will come along and index your site. It will "read" the content, including any Meta tag data and then continue on and follow any links out of the site to other pages. This data is then passed by the spider to a central collection point where this data is all indexed. Any sites that have been found via your links will also be indexed.

Therefore, when you type in a search term in a search engine for it locate relevant information for you, it actually searches its index for the information, not the Web.

The spiders will sporadically return to these sites to check for any updates or information that may have changed and the frequency with which this occurs is dependent on the arbitrator of the particular engine.

Different Search Engines like Lycos, Google or Excite use different algorithms to determine the ranking of web pages, each using a slightly different set of criteria to evaluate "relevancy" in the indices, which is why, typically, these search engines will return different search results for the same keyword term.

However, fundamentally, a search engine's algorithm is programmed to inspect for the frequency of a particular keyword, and its location. It also scans for what is known as spamdexing, or artificially stuffed keywords in a web page.

The relationship between pages, or the way in which pages are linked is then analysed by the algorithms, and this enables the search engine to determine whether the keywords in the linked pages have relevancy and are similar to the keywords that were on the original web page, as well as determining what the page is about.

Provided By: George Vlismas
George Vlismas is an online business mentor and entrepreneur who specializes in helping you, and other serious-minded entrepreneurs, use internet marketing to start, build, promote and expand your home based online businesses and create multiple, passive income streams.
Website Address: georgevlismas.com

This Article is a Private Label Rights (PLR) Article and you may freely have a copy on your web site provided you keep the above provided by signature intact (In content advertisement not required).

This Small Biz Articles Archive Entry Viewed 3,253 Times
The PermaLink for this Small Biz Articles Archive is:
How Search Engines Work - Web Spiders and Crawlers


 
Small Biz Articles Archive Menu
 
Articles Home ]   [ Ad Mgmt. ]   [ Affiliate Programs ]   [ Article Biz ]   [ Biz Ops ]   [ Blogging ]   [ eBooks ]   [ Economy ]   [ Home Business ]   [ Marketing ]   [ Newsletters ]   [ Online Business ]   [ Outsourcing ]   [ PLR ]   [ SEO ]   [ Web Consulting ]   [ Web Sites ]   [ Writing ]   [ All In Order ] 
 
Search Articles ]  ]   [ Add to Technorati Favorites ]   [ Subscribe To Raw XML file ] 
Go To Top Of Page