Chap#1: How Search Engines Work? (Google, Yahoo, Bing)

Search engines have four functions – crawling, building an index, calculating relevancy & rankings and serving results

Crawling and Indexing

Crawling and Indexing

Imagine the World Wide Web as a network of stops in a big city subway system.

Each stop is its own unique document (usually a web page, but sometimes a PDF, JPG or other file). The search engines need a way to “crawl” the entire city and find all the stops along the way, so they use the best path available – links.

“The link structure of the web serves to bind together all of the pages in existence.”

(Or, at least, all those that the engines can access.) Through links, search engines’ automated robots, called “crawlers,” or “spiders” can reach the many billions of interconnected documents.

Once the engines find these pages, their next job is to parse the code from them and store selected pieces of the pages in massive hard drives, to be recalled when needed in a query. To accomplish the monumental task of holding billions of pages that can be accessed in a fraction of a second, the search engines have constructed massive data centers in cities all over the world.

These monstrous storage facilities hold thousands of machines processing unimaginably large quantities of information. After all, when a person performs a search at any of the major engines, they demand results instantaneously – even a 3 or 4 second delay can cause dissatisfaction, so the engines work hard to provide answers as fast as possible.

Providing Answers

Providing Answers

When a person searches for something online, it requires the search engines to scour their corpus of billions of documents and do two things – first, return only those results that are relevant or useful to the searcher’s query, and second, rank those results in order of perceived value (or importance). It is both “relevance” and “importance” that the process of search engine optimization is meant to influence.

To the search engines, relevance means more than simply having a page with the words you searched for prominently displayed. In the early days of the web, search engines didn’t go much further than this simplistic step, and found that their results suffered as a consequence. Thus, through iterative evolution, smart engineers at the various engines devised better ways to find valuable results that searchers would appreciate and enjoy. Today, hundreds of factors influence relevance, many of which we’ll discuss throughout this guide or you can find out our daily tips on our Facebook Page  or twitter account.

Importance is an equally tough concept to quantify, but search engines must do their best.

Currently, the major engines typically interpret importance as popularity – the more popular a site, page or document, the more valuable the information contained therein must be. This assumption has proven fairly successful in practice, as the engines have continued to increase users’ satisfaction by using metrics that interpret popularity.

Popularity and relevance aren’t determined manually (and thank goodness, because those trillions of man-hours would require earth’s entire population as a workforce). Instead, the engines craft careful, mathematical equations – algorithms – to sort the wheat from the chaff and to then rank the wheat in order of tastiness (or however it is that farmers determine wheat’s value). These algorithms are often comprised of hundreds of components. In the search marketing field, we often refer to them as “ranking factors” For those who are particularly interested, we crafted a resource specifically on this subject – Search Engine Ranking Factors.

Search Engine Results

You can surmise that search engines believe that Ohio State is the most relevant and popular page for the query “Universities” while the result, Harvard, is less relevant/popular.

So How Do I Get Some Success Rolling in?

How Online Marketers Study & Learn How to Succeed in Engines

The complicated algorithms of search engines may appear at first glance to be impenetrable, and the engines themselves provide little insight into how to achieve better results or garner more traffic. What little information on optimization and best practices that the engines themselves do provide is listed below:

Google

SEO information from Google (webmaster guidelines)

Googlers recommend the following to get better rankings in their search engine:

  • Make pages primarily for users, not for search engines. Don’t deceive your users or present different content to search engines than you display to users, which is commonly referred to as cloaking.
  • Make a site with a clear hierarchy and text links. Every page should be reachable from at least one static text link.
  • Create a useful, information-rich site, and write pages that clearly and accurately describe your content. Make sure that your <title> elements and ALT attributes are descriptive and accurate.
  • Keep the links on a given page to a reasonable number (fewer than 100).

Yahoo!

SEO information from Yahoo (webmaster guidelines)

Many factors influence whether a particular web site appears in Web Search results and where it falls in the ranking.

These factors can include:

  • The number of other sites linking to it
  • The content of the pages
  • The updates made to indices
  • The testing of new product versions
  • The discovery of additional sites
  • Changes to the search algorithm – and other factors
Bing

SEO information from Bing (webmaster guidelines)

Bing engineers at Microsoft recommend the following to get better rankings in their search engine:

  • In the visible page text, include words users might choose as search query terms to find the information on your site.
  • Limit all pages to a reasonable size. We recommend one topic per page. An HTML page with no pictures should be under 150 kb.
  • Make sure that each page is accessible by at least one static text link.
  • Don’t put the text that you want indexed inside images. For example, if you want your company name or address to be indexed, make sure it is not displayed inside a company logo.

An article by Seomoz.org. (Courtesy of Pludu Inc.)

Advertisements

32 thoughts on “Chap#1: How Search Engines Work? (Google, Yahoo, Bing)

  1. How Search Engines Work? (Google, Yahoo, Bing) | Umayr Javed I was suggested this blog by my cousin. I am not sure whether this post is written by him as no one else know such detailed about my difficulty. You’re amazing! Thanks! your article about How Search Engines Work? (Google, Yahoo, Bing) | Umayr Javed Best Regards Agata Lawrence

  2. Wow, incredible blog layout! How long have you been blogging for? you made blogging look easy. The overall look of your web site is great, let alone the content!. Thanks For Your article about How Search Engines Work? (Google, Yahoo, Bing) | Umayr Javed .

  3. Chap#1: How Search Engines Work? (Google, Yahoo, Bing) | Umayr Javed I was suggested this web site by my cousin. I am not sure whether this post is written by him as no one else know such detailed about my problem. You are incredible! Thanks! your article about Chap#1: How Search Engines Work? (Google, Yahoo, Bing) | Umayr JavedBest Regards Lawrence

  4. fantastic set up, really informative. I wonder why the other specialists of the sector do not notice this. You need to continue your writing. Me self-confident, you’ve a massive readers’ foundation already!

    • Kristal, I am glad that you guys are liking my effort. My aim is to make this blog a place where you find real steps, best practices and TO-DOs actually of internet marketing and other areas and NOT where you just invest your precious time and get nothing but just information that you can never utilize.

  5. I do agree with all of the ideas you have introduced to your post. They’re really convincing and can certainly work. Still, the posts are very short for newbies. Could you please prolong them a bit from next time? Thank you for the post.

  6. After reading your blog post I browsed your website a bit and noticed you aren’t ranking nearly as well in Google as you could be. I possess a handful of blogs myself and I think you should take a look here: http://seopressors.org You’ll find it’s a very nice tool that can bring you a lot more visitors. Keep up the quality posts

  7. Hi there! This blog post couldn’t be written any better! Reading through this article reminds me of my previous roommate! He continually kept preaching about this. I will forward this post to him. Fairly certain he will have a great read. Thank you for sharing!

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s