WWWHelper

Small Business Resource Center

Print This Page


Site Menu

FYI...

Small Business Web Hosting Plans
Economical Web Hosting Plans For Small Businesses Or Personal Web sites:
Flux Services, Inc. owners of Ultra Website Hosting Company is a web hosting company located in Puyallup, WA. Flux Services, Inc. is a web hosting provider that delivers full featured, high quality hosting services at low prices and high value! You can find everything you need to get yo...

Add Audio To Your Website With A Simple Step-By-Step Flash Audio Wizard Program
A Simple Step-By-Step Flash Audio Wizard That Creates Everything You Need To Add Audio To Your Website:
A Simple Step-By-Step Flash Audio Wizard That Creates Everything You Need To Add Audio To Your Website FACT:Adding Audio To Your Website Can Increase Performance by up to 312% Are you using audio yet? If the answer is NO ... You could be losing out on hundreds of extra follow up subscr...

Internet Business Boot Camp
Internet Business Boot Camp For Starting and Running an Online Business Web Site:
Internet Business Boot Camp For Starting and Running an Online Business Web Site Now At Long Last, the Confusion and Guesswork of Starting an Online Business is Over.. Are You Thinking of Starting a Business on the Web? do You Need to Jump-Start an Existing Business? If you are not yet ...

Web Design, The Art of Simple
Save The Pixel an eBook on The Art of Simple Web Design:
Save The Pixel The Art of Simple Web Design Renowned design and usability pro, Ben Hunt, wants to Save the Pixel. Every day literally squillions of pixels are enslaved into creating web pages that confuse, frighten and irritate. Overview By taking us on a tour through over twen...

Small Biz Articles Archive Category: SEO
 
Small Biz Articles Archive Menu
 
Articles Home ]   [ Ad Mgmt. ]   [ Affiliate Programs ]   [ Article Biz ]   [ Biz Ops ]   [ Blogging ]   [ eBooks ]   [ Economy ]   [ Home Business ]   [ Marketing ]   [ Newsletters ]   [ Online Business ]   [ Outsourcing ]   [ PLR ]   [ SEO ]   [ Web Consulting ]   [ Web Sites ]   [ Writing ]   [ All In Order ] 
 
Search Articles ]  ]   [ Add to Technorati Favorites ]   [ Subscribe To Raw XML file ] 
 

"How Search Engines Work - Web Spiders and Crawlers"


There are no comments shared for this Small Biz Articles Archive.

Click here to be the first to share your comments for this Small Biz Articles Archive.

Monday, March 15, 2010

Perhaps it's best to start off here by making a slight, but important distinction about Search Engines, and that is that generally when people mention the term Internet Search Engines, what they're actually are referring to - at least in this day and age - are World Wide Web Search Engines. This is because now, the WWW has become, by far, the biggest part of the Internet and so most searches now are limited to the "Web".

So, ultimately, it's these search engines that find and make your website visible to Web users and prospective clients. It is therefore very helpful for us to know, at least in principle, the inner workings of these engines, and how they go about finding and presenting information to Web users searching for information.

The search for what the user has queried begins with special software bots (or robots) called spiders which are basically employed by the search engines to go out and find the relevant information across the millions of websites - and then come back and build lists of the related words they have found.

This procedure is called Web Crawling, and it's a rather involved and intense process of building and maintaining lists of related words from a huge number of pages.

So essentially a spider is an automated program that fetches Web Pages automatically and feeds this information to the engine.

But where does it all begin? The spider's journey actually starts "top down" - so from the most popular and most heavily visited pages and sites, and works its way down to other sites and servers using the links present in these pages.

So, when you submit website pages to an engine, their spider will come along and index your site. It will "read" the content, including any Meta tag data and then continue on and follow any links out of the site to other pages. This data is then passed by the spider to a central collection point where this data is all indexed. Any sites that have been found via your links will also be indexed.

Therefore, when you type in a search term in a search engine for it locate relevant information for you, it actually searches its index for the information, not the Web.

The spiders will sporadically return to these sites to check for any updates or information that may have changed and the frequency with which this occurs is dependent on the arbitrator of the particular engine.

Different Search Engines like Lycos, Google or Excite use different algorithms to determine the ranking of web pages, each using a slightly different set of criteria to evaluate "relevancy" in the indices, which is why, typically, these search engines will return different search results for the same keyword term.

However, fundamentally, a search engine's algorithm is programmed to inspect for the frequency of a particular keyword, and its location. It also scans for what is known as spamdexing, or artificially stuffed keywords in a web page.

The relationship between pages, or the way in which pages are linked is then analysed by the algorithms, and this enables the search engine to determine whether the keywords in the linked pages have relevancy and are similar to the keywords that were on the original web page, as well as determining what the page is about.

Provided By: George Vlismas
George Vlismas is an online business mentor and entrepreneur who specializes in helping you, and other serious-minded entrepreneurs, use internet marketing to start, build, promote and expand your home based online businesses and create multiple, passive income streams.
Website Address: georgevlismas.com

This Article is a Private Label Rights (PLR) Article and you may freely have a copy on your web site provided you keep the above provided by signature intact (In content advertisement not required).

This Small Biz Articles Archive Entry Viewed 2,591 Times
The PermaLink for this Small Biz Articles Archive is:
How Search Engines Work - Web Spiders and Crawlers


 
Small Biz Articles Archive Menu
 
Articles Home ]   [ Ad Mgmt. ]   [ Affiliate Programs ]   [ Article Biz ]   [ Biz Ops ]   [ Blogging ]   [ eBooks ]   [ Economy ]   [ Home Business ]   [ Marketing ]   [ Newsletters ]   [ Online Business ]   [ Outsourcing ]   [ PLR ]   [ SEO ]   [ Web Consulting ]   [ Web Sites ]   [ Writing ]   [ All In Order ] 
 
Search Articles ]  ]   [ Add to Technorati Favorites ]   [ Subscribe To Raw XML file ] 
Go To Top Of Page