WWWHelper

Small Business Resource Center

Print This Page


Site Menu

FYI...

Buying Traffic For an Affiliate Website
Buying Traffic For an Affiliate Website:
There are various places from where you can buy website traffic. You might look at popunders, expired domains, banner adverts or Pay Per Click. For the beginner, only one of these will normally produce the goods. Whilst popunders and expired domain traffic (dressed up under a variety of diffe...

Starting a Home Based Internet Business in Times of Recession
Is Starting a Home Based Internet Business Your Best Option In These Times of Recession:
Is it advisable to start a home based internet business in times of recession? There is no perfect time to launch your own business, the best time is when you decide to do it. At the current challenging economic time, many people are worried about their jobs. Large companies are laying off their s...

Here\'s How You Can Succeed Online
Here's How You Can Succeed Online:
Marketing products are a great way to earn a living and being creative at the same time. I'd compare it to fishing; you have to try different lures to attract the right customer. The ideas to market are endless, just stop by any internet forum and you will have enough ideas to try out for a very l...

Cashing in on the Crisis - Starting a Business During a Recession
Cashing in on the Crisis - Starting a Business During a Recession:
We have all heard about the financial crisis that is currently plaguing our country and even our entire world. It is a pretty bad ordeal, there is no question to that. But is it really all that bad? I submit that, even though those who have invested in the stock markets may have temporar...

Small Biz Articles Archive Category: SEO
 
Small Biz Articles Archive Menu
 
Articles Home ]   [ Ad Mgmt. ]   [ Affiliate Programs ]   [ Article Biz ]   [ Biz Ops ]   [ Blogging ]   [ eBooks ]   [ Economy ]   [ Home Business ]   [ Marketing ]   [ Newsletters ]   [ Online Business ]   [ Outsourcing ]   [ PLR ]   [ SEO ]   [ Web Consulting ]   [ Web Sites ]   [ Writing ]   [ All In Order ] 
 
Search Articles ]  ]   [ Add to Technorati Favorites ]   [ Subscribe To Raw XML file ] 
 

"How Search Engines Work - Web Spiders and Crawlers"


There are no comments shared for this Small Biz Articles Archive.

Click here to be the first to share your comments for this Small Biz Articles Archive.

Monday, March 15, 2010

Perhaps it's best to start off here by making a slight, but important distinction about Search Engines, and that is that generally when people mention the term Internet Search Engines, what they're actually are referring to - at least in this day and age - are World Wide Web Search Engines. This is because now, the WWW has become, by far, the biggest part of the Internet and so most searches now are limited to the "Web".

So, ultimately, it's these search engines that find and make your website visible to Web users and prospective clients. It is therefore very helpful for us to know, at least in principle, the inner workings of these engines, and how they go about finding and presenting information to Web users searching for information.

The search for what the user has queried begins with special software bots (or robots) called spiders which are basically employed by the search engines to go out and find the relevant information across the millions of websites - and then come back and build lists of the related words they have found.

This procedure is called Web Crawling, and it's a rather involved and intense process of building and maintaining lists of related words from a huge number of pages.

So essentially a spider is an automated program that fetches Web Pages automatically and feeds this information to the engine.

But where does it all begin? The spider's journey actually starts "top down" - so from the most popular and most heavily visited pages and sites, and works its way down to other sites and servers using the links present in these pages.

So, when you submit website pages to an engine, their spider will come along and index your site. It will "read" the content, including any Meta tag data and then continue on and follow any links out of the site to other pages. This data is then passed by the spider to a central collection point where this data is all indexed. Any sites that have been found via your links will also be indexed.

Therefore, when you type in a search term in a search engine for it locate relevant information for you, it actually searches its index for the information, not the Web.

The spiders will sporadically return to these sites to check for any updates or information that may have changed and the frequency with which this occurs is dependent on the arbitrator of the particular engine.

Different Search Engines like Lycos, Google or Excite use different algorithms to determine the ranking of web pages, each using a slightly different set of criteria to evaluate "relevancy" in the indices, which is why, typically, these search engines will return different search results for the same keyword term.

However, fundamentally, a search engine's algorithm is programmed to inspect for the frequency of a particular keyword, and its location. It also scans for what is known as spamdexing, or artificially stuffed keywords in a web page.

The relationship between pages, or the way in which pages are linked is then analysed by the algorithms, and this enables the search engine to determine whether the keywords in the linked pages have relevancy and are similar to the keywords that were on the original web page, as well as determining what the page is about.

Provided By: George Vlismas
George Vlismas is an online business mentor and entrepreneur who specializes in helping you, and other serious-minded entrepreneurs, use internet marketing to start, build, promote and expand your home based online businesses and create multiple, passive income streams.
Website Address: georgevlismas.com

This Article is a Private Label Rights (PLR) Article and you may freely have a copy on your web site provided you keep the above provided by signature intact (In content advertisement not required).

This Small Biz Articles Archive Entry Viewed 2,323 Times
The PermaLink for this Small Biz Articles Archive is:
How Search Engines Work - Web Spiders and Crawlers


 
Small Biz Articles Archive Menu
 
Articles Home ]   [ Ad Mgmt. ]   [ Affiliate Programs ]   [ Article Biz ]   [ Biz Ops ]   [ Blogging ]   [ eBooks ]   [ Economy ]   [ Home Business ]   [ Marketing ]   [ Newsletters ]   [ Online Business ]   [ Outsourcing ]   [ PLR ]   [ SEO ]   [ Web Consulting ]   [ Web Sites ]   [ Writing ]   [ All In Order ] 
 
Search Articles ]  ]   [ Add to Technorati Favorites ]   [ Subscribe To Raw XML file ] 
Go To Top Of Page