WWWHelper

Small Business Resource Center

Print This Page


Site Menu

FYI...

16. Plan to Maintain Your Web Site for the Long Haul
Discussion On The Importance of Maintaining Your Web Site for the Long Haul:
Once a web site is up and running it is important for you to understand the significance of maintaining it on a regular basis. Experts recommend that the information and style of your web site should be updated often so as to keep your visitors interested. It is also important that your web site i...

12. Building Your Online Business Website Part 2
Before Starting A Business Web Site You Need To Lay Out A Plan:
Plan Your Website Planning your web site is the most important and interesting stage in the development and creation of a website. This is a time for introspection and for putting your thoughts together. Here are some of the key issues you need to consider and pen down your responses before you m...

09. Let's Get Started, Create The Business Legally
Start Your Online Business Legally By Registering Your Business And Creating Your Brand Identity:
What is Your Business? You need to clearly understand what your business is, what you expect of it and how you want to portray it to your customers. It makes a lot of sense to put down on paper your business plan. This will clarify a lot of issues that you may not have considered before, and is a...

04. Consider Your Passions First When Deciding On Your Online Business
Consider What You Love To Do Or Your Passions First When Deciding On Your Online Business:
To help us sort out which niche you should enter, we will need to evaluate what your interests are. I start here because most people would rather do something they enjoy than do something they do not enjoy ,and have to be forced to do. Odds are you will more likely succeed, if you are enjoyi...

Small Biz Articles Archive Category: SEO
 
Small Biz Articles Archive Menu
 
Articles Home ]   [ Ad Mgmt. ]   [ Affiliate Programs ]   [ Article Biz ]   [ Biz Ops ]   [ Blogging ]   [ eBooks ]   [ Economy ]   [ Home Business ]   [ Marketing ]   [ Newsletters ]   [ Online Business ]   [ Outsourcing ]   [ PLR ]   [ SEO ]   [ Web Consulting ]   [ Web Sites ]   [ Writing ]   [ All In Order ] 
 
Search Articles ]  ]   [ Add to Technorati Favorites ]   [ Subscribe To Raw XML file ] 
 

"How Search Engines Work - Web Spiders and Crawlers"


There are no comments shared for this Small Biz Articles Archive.

Click here to be the first to share your comments for this Small Biz Articles Archive.

Monday, March 15, 2010

Perhaps it's best to start off here by making a slight, but important distinction about Search Engines, and that is that generally when people mention the term Internet Search Engines, what they're actually are referring to - at least in this day and age - are World Wide Web Search Engines. This is because now, the WWW has become, by far, the biggest part of the Internet and so most searches now are limited to the "Web".

So, ultimately, it's these search engines that find and make your website visible to Web users and prospective clients. It is therefore very helpful for us to know, at least in principle, the inner workings of these engines, and how they go about finding and presenting information to Web users searching for information.

The search for what the user has queried begins with special software bots (or robots) called spiders which are basically employed by the search engines to go out and find the relevant information across the millions of websites - and then come back and build lists of the related words they have found.

This procedure is called Web Crawling, and it's a rather involved and intense process of building and maintaining lists of related words from a huge number of pages.

So essentially a spider is an automated program that fetches Web Pages automatically and feeds this information to the engine.

But where does it all begin? The spider's journey actually starts "top down" - so from the most popular and most heavily visited pages and sites, and works its way down to other sites and servers using the links present in these pages.

So, when you submit website pages to an engine, their spider will come along and index your site. It will "read" the content, including any Meta tag data and then continue on and follow any links out of the site to other pages. This data is then passed by the spider to a central collection point where this data is all indexed. Any sites that have been found via your links will also be indexed.

Therefore, when you type in a search term in a search engine for it locate relevant information for you, it actually searches its index for the information, not the Web.

The spiders will sporadically return to these sites to check for any updates or information that may have changed and the frequency with which this occurs is dependent on the arbitrator of the particular engine.

Different Search Engines like Lycos, Google or Excite use different algorithms to determine the ranking of web pages, each using a slightly different set of criteria to evaluate "relevancy" in the indices, which is why, typically, these search engines will return different search results for the same keyword term.

However, fundamentally, a search engine's algorithm is programmed to inspect for the frequency of a particular keyword, and its location. It also scans for what is known as spamdexing, or artificially stuffed keywords in a web page.

The relationship between pages, or the way in which pages are linked is then analysed by the algorithms, and this enables the search engine to determine whether the keywords in the linked pages have relevancy and are similar to the keywords that were on the original web page, as well as determining what the page is about.

Provided By: George Vlismas
George Vlismas is an online business mentor and entrepreneur who specializes in helping you, and other serious-minded entrepreneurs, use internet marketing to start, build, promote and expand your home based online businesses and create multiple, passive income streams.
Website Address: georgevlismas.com

This Article is a Private Label Rights (PLR) Article and you may freely have a copy on your web site provided you keep the above provided by signature intact (In content advertisement not required).

This Small Biz Articles Archive Entry Viewed 2,125 Times
The PermaLink for this Small Biz Articles Archive is:
How Search Engines Work - Web Spiders and Crawlers


 
Small Biz Articles Archive Menu
 
Articles Home ]   [ Ad Mgmt. ]   [ Affiliate Programs ]   [ Article Biz ]   [ Biz Ops ]   [ Blogging ]   [ eBooks ]   [ Economy ]   [ Home Business ]   [ Marketing ]   [ Newsletters ]   [ Online Business ]   [ Outsourcing ]   [ PLR ]   [ SEO ]   [ Web Consulting ]   [ Web Sites ]   [ Writing ]   [ All In Order ] 
 
Search Articles ]  ]   [ Add to Technorati Favorites ]   [ Subscribe To Raw XML file ] 
Go To Top Of Page