CSC 379 SUM2008:Week 2, Group 3

Search Engines

Search engines fill an important role in our lives, helping us locate information within a wide array of multimedia. However many ethical considerations are involved in their operation; the ordering of rankings, the range of content indexed (or not), and how advertisements are incorporated, are a few. Broadly examine the ethics of search engine operation and use.

• http://www.i-r-i-e.net/inhalt/003/003_hinman.pdf
• http://www.i-r-i-e.net/inhalt/003/003_editorial.pdf
• http://www.boingboing.net/2008/04/04/usfunded-health-sear.html
• http://www.scu.edu/ethics/publications/submitted/search-engine-panel.html

Function

A search engine is an information retrieval system that match queries with an index it creates. Search engines consist of four essential modules:

1. Document Processor - this prepares, processes, and inputs the documents, pages, or sites that users search against.
2. Query Processor - this consist of seven possible steps
   • Tokenizing usually by breaking inputs into strings separated by white space.
   • Parsing operators like reserved punctuation or reserved terms in specialized format (e.g., AND, OR). This may also include boolean, adjacency, or proximity operators.
   • Stop list and stemming might contain words from commonly occurring querying phrases. Engines may drop these two steps.
   • Creating the query depends on the method used to do the matching.
   • Query expansion employs synonyms to optimize the search results.
   • Query term weighting is used to judge the importance of each term in the query.
3. Search and Matching Function - this is based on which theoretical model of information retrieval underlies the system's design philosophy.
4. Ranking Capability - this is done several ways
   • Term frequency
   • Location of terms
   • Link analysis
   • Popularity
   • Date of Publication
   • Length
   • Proximity of query terms
   • Proper nouns

Issues

Algorithms

The algorithms that were initially used were fairly basic and objective. They were based such criterion as number of visits to a page or the number of pages that link to a certain page. The success and popularity of Google is attributed to their more subjective approach. Google implemented an algorithm that is meant to find what users are looking for instead of offering the most popular results, which is not always the same thing. With varying algorithms, each search engine will produce different results. The secrecy of their algorithm is what gives Google their competitive edge.

Advertisements

Including advertisements on a search engine is nothing new. For years, these ads had no affect on search results. The inclusion of advertisements in search results has given rise to many fair use and comparative advertising issues. Ads have been given three classifications:

• Paid placement is advertising that is outside of the editorial content of the search results, sometimes above or below the editorial content, or in a sidebar.
• Paid inclusion is advertising within the editorial content of the search results, though it does not necessarily guarantee a certain position within the results.
• Paid submission is the practice of requiring payment to speed up the processing of a listing, though it rarely guarantees that a site will in fact be listed by the search engine.

Consumers groups have objected only to the first two practices, claiming that ads should clearly be identified as ads.

Politics

Nowadays search engine are playing the role of a gatekeeper to the ocean of information on the web. Because of the same reason they are playing a critical role in society both ethically and politically. It is the search engines that decide what is relevant and what is not when one does a search. They are the ones who decide the order and the ranking of the websites on the search result.

Google has claimed that they have a clear separation between the editorial contents and the advertising content the same way that newspaper and magazines have editorial staffs and advertising staffs.

There were rumors that some companies would charge those who wanted their website to have a different ranking, or even sometimes they would do hand manipulation based on their own assumption that what should be first. Because of the very reason many search engine companies now claim there are algorithms that has been developed by their developers, then debugged, and now being used so that everything is done algorithmically and no one can buy their ranking, and moreover they will not reveal their algorithm since there is a chance that it would get abused.

External Links

How a Search Engine Works

Search Engine Ads Stir Controversy