Case Study: Assigning genre labels to random web pages

From WebGenreWiki

Survey (See Comments and Results)

Labels assigned by 8 authors to 50 random web pages:

Annotators:

  1.   Rehm       
  2.   Santini    
  3.   Braslavski 
  4.   Stubbe     
  5.   Symonenko  
  6.   Tavosanis  
  7.   Vidulin    
  8.   Sharoff (book chapter, for categories see http://corpus.leeds.ac.uk/serge/webgenres/ )

Assessment:

 High Consistency in Label Assignments (5 or more annotators used the same label)
 Medium Consistency in Label Assignments (3 or 4 annotators used the same label)
 Low Consistency in Label Assignments (2 or less annotators used the same label)

Web Page [1] http://answers.yahoo.com/

  Low Consistency in Label Assignments
 
  1. Entry page of a digital information desk service
  2. query page
  3. FAQ, online help
  4. FAQ
  5. homepage of an answer community portal
  6. Homepage
  7. Community, Index
  8. Information/Linkerie

Web Page [2] http://catb.org/~esr/faqs/hacker-howto.html

  Medium Consistency in Label Assignments (FAQ)
 
  1. Article          
  2. how-to           
  3. instruction, FAQ 
  4. FAQ              
  5. faq              
  6. Explanation      
  7. Informative      
  8. Instruction

Web Page [3] http://chicagotribune.com/tech/

  Medium Consistency in Label Assignments (newspaper)
 
  1.  Department entry page of an online newspaper 
  2.  online newspaper article snippet
  3.  newspaper, portal
  4.  Newspaper Homepage
  5.  a newspaper section
  6.  Homepage
  7.  Journalistic, Content Delivery
  8.  Information/Linkerie

Web Page [4] http://digital.library.upenn.edu/women/

  Low Consistency in Label Assignments
 
  1.  Entry page of the website of an academic organization
  2.  introductory page
  3.  link collection
  4.  Bibliography/List of Books
  5.  an entry page to a special digital library collection
  6.  Homepage
  7.  Index, Commercial/Promotional
  8.  Information/Linkerie

Web Page[5] http://dir.yahoo.com/Entertainment/Movies_and_Film

  Medium Consistency in Label Assignments (directory)
 
  1.  Index of a web catalogue 
  2.  directory
  3.  web directory (a special case of link collection)
  4.  Linklist
  5.  a web directory section
  6.  List of resources
  7.  Index
  8.  Information/Linkerie

Web Page [6] http://editorial.autos.msn.com/article.aspx?cp-documentid=435749

  Medium Consistency in Label Assignments (article)
 
  1.  Article 
  2.  car review/ article
  3.  article
  4.  Advertisment/Reportage
  5.  a new product infomercial
  6.  Product review
  7.  Journalistic
  8.  Discussion

Web Page [7] http://en.wikipedia.org/wiki/MSN_Groups

  Medium Consistency in Label Assignments (entry)
 
  1.  Entry in an online encyclopedia 
  2.  wikipedia entry
  3.  wikipedia entry (informative)
  4.  Encyclopedia
  5.  a Web 2.0 encyclopedia entry
  6.  Explanation
  7.  Informative
  8.  Discussion

Web Page [8] http://espn.go.com/

  Low Consistency in Label Assignments
 
  1.  Entry page of a sports news website 
  2.  online sport newspaper front page
  3.  newspaper, portal
  4.  Crashed my Browser. News?
  5.  a homepage of a sports portal
  6.  Homepage
  7.  Journalistic, Index
  8.  Information

Web Page [9] http://links.jstor.org/sici?sici=0022-2984(196624)35%3A1%3C77%3AODPATJ%3E2.0.CO%3B2-4

  Low Consistency in Label Assignments
 
  1.  Research article 
  2.  citation with access option
  3.  reference, informative
  4.  Scientific Article
  5.  an entry page to an academic article available on subscription basis
  6.  Academic paper
  7.  Scientific
  8.  Discussion

Web Page [10] http://money.aol.com

  Medium Consistency in Label Assignments (homepage)
 
  1.  Entry page of a finance news website 
  2.  blog entries with mini-surveys
  3.  newspaper, portal
  4.  Newspaper Homepage: News, Polls, Statisitics
  5.  an homepage of a finance portal
  6.  Homepage
  7.  Journalistic, Index, User Input
  8.  Information/Linkerie

Web Page [11] http://money.cnn.com/real_estate/

  Low Consistency in Label Assignments
 
  1.  Department entry page of a news website 
  2.  composite informational 
  3.  newspaper, portal
  4.  Newspaper Homepage
  5.  a topic-specific section of an information portal
  6.  Homepage
  7.  Journalistic, Index
  8.  Information/Linkerie

Web Page [12] http://pra.aps.org

  Low Consistency in Label Assignments
 
  1.  Entry page of the website of a research journal 
  2.  composite informational 
  3.  newspaper, portal
  4.  "About-page"
  5.  a homepage of a subscription-based academic journal
  6.  Homepage
  7.  Commercial/Promotional
  8.  Information

Web Page [13] http://pubs.acs.org/journals/jpcafh/index.html

  Low Consistency in Label Assignments
 
  1.  Entry page of the website of a research journal 
  2.  table of contents with snippets
  3.  portal, link collection
  4.  Bibliography/List of Articles
  5.  a homepage of a subscription-based academic journal
  6.  Homepage
  7.  Index, Content Delivery
  8.  Information

[14] http://query.nytimes.com/gst/abstract.html?res=9903E0DF1338EE3BBC4E52DFB466838B679FDE

  Medium Consistency in Label Assignments (article)
 
  1.  News article 
  2.  article preview with commercial
  3.  newspaper
  4.  News
  5.  an entry page to a free article in an newspaper 
  6.  News article
  7.  Journalistic, Content Delivery
  8.  Discussion

Web Page [15] http://sprg.ssl.berkeley.edu/fast/science/papers/ergun/ree_fast_SW/welcome.html

  Medium Consistency in Label Assignments (academic paper)
 
  1.  Research article 
  2.  academic paper
  3.  scientific paper
  4.  Scientific Paper
  5.  an academic article
  6.  Academic paper
  7.  Scientific
  8.  Discussion

Web Page [16] http://tv.msn.com/tv/tvbuzz

  Low Consistency in Label Assignments
 
  1.  Feature article 
  2.  tv program presentation
  3.  newspaper
  4.  "About-page"
  5.  a tv guide page for a particular program
  6.  Explanation
  7.  Journalistic
  8.  Information/Linkerie

Web Page [17] http://www.allcoast.com/discussion/ViewTopic.cfm?topic_ID=86805&todaysTopics=true&page=2&printerfriendly=true

  Low Consistency in Label Assignments
 
  1.  Discussion forum 
  2.  blog post
  3.  forum
  4.  Bulletin Board
  5.  a thread in a discussion board
  6.  Discussion
  7.  Community
  8.  Discussion

Web Page [18] http://www.amazon.com/Tissue-Economies-Capitalism-Science-Cultural/dp/0822337703

  Medium Consistency in Label Assignments (shop)
 
  1.  Product description 
  2.  bookshop citation
  3.  product page, eshop
  4.  Shop
  5.  a product page in an online bookstore
  6.  Product review
  7.  Shopping
  8.  Information

Web Page [19] http://www.apple.com/getamac/

  Medium Consistency in Label Assignments (advertisement)
 
  1.  Product feature advertisement 
  2.  infomrational+advertising web page
  3.  product page, promotion
  4.  Advertisment/Information
  5.  an ad/infomercial
  6.  Product information
  7.  Commercial/Promotional
  8.  Propaganda

Web Page [20] http://www.bizrate.com

  Medium Consistency in Label Assignments (shop)
 
  1.  Entry page of a webshop 
  2.  shopping catalogue
  3.  eshop
  4.  Shop
  5.  a homepage of a mega-shopping site
  6.  Homepage
  7.  Index

Web Page [21] http://www.brookings.edu/articles/2002/spring_environment_burtraw.aspx

  High Consistency in Label Assignments (article)
 
  1.  News article 
  2.  article/commentary
  3.  article
  4.  Feature
  5.  a newsletter article
  6.  News article
  7.  Journalistic

Web Page [22] http://www.cafemom.com/groups/

  Medium Consistency in Label Assignments (list)
 
  1.  Listing of discussion forums 
  2.  index/search page/post snippets
  3.  portal
  4.  Linklist+Bulletin Board
  5.  a homepage of a women's community site
  6.  List of resources
  7.  Index, Community

Web Page [23] http://www.careerbuilder.com

  Medium Consistency in Label Assignments (search page/engine)
 
  1.  Entry page of a job search engine 
  2.  search page (jobs)
  3.  a specialized search engine, online service
  4.  Search
  5.  a homepage of a job portal
  6.  Homepage
  7.  User Input, Index

Web Page [24] http://www.dallasnews.com/sharedcontent/dws/fea/shopping/vitindex.html

  Low Consistency in Label Assignments
 
  1.  List of news items 
  2.  composite subwebsite entry page
  3.  newspaper
  4.  News
  5.  an entry page to a shopping section in an online newspaper
  6.  Journalistic [supergenre]
  7.  Journalistic

Web Page [25] http://www.fastcompany.com/articles/2007/01/top_jobs_2007.html

  High Consistency in Label Assignments (article)
 
  1.  Feature article 
  2.  article (explanatory)
  3.  article
  4.  Feature
  5.  an article in a magazine
  6.  News article
  7.  Journalistic

Web Page [26] http://www.fatwallet.com/c/52/

  Low Consistency in Label Assignments
 
  1.  List of discussion forums 
  2.  ranked toc
  3.  forum
  4.  Bulletin Board
  5.  a list of threads in a discussion board
  6.  Discussion
  7.  Community

Web Page [27] http://www.freepatentsonline.com/6081819.html

  High Consistency in Label Assignments (patent)
 
  1.  Patent specification 
  2.  toc with snippets
  3.  patent, close to scientific paper
  4.  Patent
  5.  a patent page
  6.  Law
  7.  Scientific

Web Page [28] http://www.insurance.com/quotes/auto.aspx

  Medium Consistency in Label Assignments (search (page/engine))
 
  1.  Department entry page of a webshop 
  2.  search page with tips
  3.  newspaper, portal
  4.  Search+Information
  5.  an entry page to a custom insurance quote
  6.  Search
  7.  Commercial/Promotional, Journalistic, Index

Web Page [29] http://www.laetusinpraesens.org/docs/cultency.php

  Medium Consistency in Label Assignments (proposal)
 
  1.  Project proposal 
  2.  proposal
  3.  formal document, somewhat close to scuentific paper 
  4.  Proposal+Lexicon
  5.  a publication proposal
  6.  Proposal
  7.  Scientific

Web Page [30] http://www.latimes.com/entertainment/dating/

  Medium Consistency in Label Assignments (search (page/engine))
 
  1.  Lonely hearts ad search engine 
  2.  search page
  3.  online service
  4.  Search
  5.  a dating page in a newspaper
  6.  Search
  7.  User Input

Web Page [31] http://www.lib.utexas.edu/maps/

  Medium Consistency in Label Assignments (list)
 
  1.  Entry page of the website of a collection 
  2.  index
  3.  link collection
  4.  Linklist
  5.  an entry page to a special digital library collection
  6.  List of resources
  7.  Index

Web Page [32] http://www.mamablogga.com

  High Consistency in Label Assignments (blog)
 
  1.  Blog 
  2.  blog
  3.  blog
  4.  Reportage/Diary
  5.  a blog's homepage
  6.  Blog
  7.  Blog, Personal

Web Page [33] http://www.myspace.com/index.cfm?fuseaction=music

  Low Consistency in Label Assignments

  1.  List of musicians and bands 
  2.  home page
  3.  portal
  4.  Homepage/Linklist
  5.  an entry page to an topic-specific online community
  6.  List of resources
  7.  Content Delivery, Index

Web Page [34] http://www.neopets.com/games/arcade.phtml

  Medium Consistency in Label Assignments (list)
 
  1.  List of games 
  2.  entry page subwebsite+catalogue
  3.  portal
  4.  Homepage/Linklist
  5.  an entry page to an online gaming community
  6.  List of resources
  7.  Index

Web Page [35] http://www.newscientist.com/channel/life/genetics/dn9575-apartheid-slashed-celtic-genes-in-early-england.html

  High Consistency in Label Assignments (article)
 
  1.  News article 
  2.  articles + boxes for comments
  3.  article
  4.  Reportage
  5.  an article in a magazine
  6.  News article
  7.  Journalistic

Web Page [36] http://www.nytimes.com/pages/realestate/

  Medium Consistency in Label Assignments (search (page/engine))
 
  1.  Department entry page of an online newspaper 
  2.  entry page subwebsite+search page
  3.  newspaper, portal
  4.  Search+Information
  5.  a topic-specific (real-estate?) section in a newspaper
  6.  Search
  7.  User Input, Shopping, Journalistic

Web Page [37] http://www.oesc.state.ok.us/hot-jobs.shtm

  Low Consistency in Label Assignments
 
  1.  List of job advertisements 
  2.  infomrational
  3.  don't know
  4.  Job Offers
  5.  a job ad page in a local government's website
  6.  List of resources
  7.  Commercial/Promotional

Web Page [38] http://www.orbitz.com

  Low Consistency in Label Assignments
 
  1.  Entry page of a travel/flight search engine 
  2.  search page (orbitz)
  3.  online service
  4.  Shop
  5.  an entry page to a travel booking website
  6.  Homepage
  7.  User Input

Web Page [39] http://www.paulgraham.com/spam.html

  Medium Consistency in Label Assignments (article)
 
  1.  Technical Article 
  2.  scientific article (contiene forumule)
  3.  article
  4.  Instruction + Code Listing
  5.  an article in a personal website
  6.  Essay
  7.  Scientific

Web Page [40] http://www.qaa.ac.uk/academicinfrastructure/codeOfPractice/section6/default.asp

  Low Consistency in Label Assignments
 
  1.  Guidelines 
  2.  instructional with index (code of practice)
  3.  official document
  4.  Instruction
  5.  a section in an academic procedures (quality & standards?) document
  6.  Law
  7.  Official

Web Page [41] http://www.rfcom.ca/toxic/heat.shtml

  Low Consistency in Label Assignments
 
  1.  List of publications 
  2.  references (with explanation)
  3.  scientific paper
  4.  Scientific Paper+Bibliography
  5.  a brief review of a topic-specific research
  6.  Academic paper
  7.  Scientific

Web Page [42] http://www.salon.com/news/feature/2006/08/01/barbaro/

  Medium Consistency in Label Assignments (article)
 
  1.  Feature article 
  2.  article
  3.  redirected, don't know
  4.  Reportage
  5.  an article in a magazine
  6.  News article
  7.  Journalistic

Web Page [43] http://www.sanger.ac.uk/HGP/Chr6/

  Medium Consistency in Label Assignments (informative/information)
 
  1.  Out of service notification 
  2.  list of references
  3.  informative, don't know
  4.  Error Message
  5.  a research project information
  6.  Product information
  7.  Informative, Index

Web Page [44] http://www.sciencedirect.com/science?_ob=ArticleURL&_udi=B6V5X-4HKMPX6-2&_user=10&_rdoc=1&_fmt=&_orig=search&_sort=d&view=c&_acct=C000050221&_version=1&_urlVersion=0&_userid=10&md5=e5ed838f44d8c88fa8df86f8a8b763c8

  Medium Consistency in Label Assignments (paper)
 
  1.  Out of service notification 
  2.  abstract
  3.  scientific paper
  4.  Scientific Paper
  5.  an entry page to an academic article available on subscription basis
  6.  Academic paper
  7.  Scientific

Web Page [45] http://www.sfgate.com/cgi-bin/article.cgi?file=/chronicle/archive/2001/03/29/MNC107792.DTL

  High Consistency in Label Assignments (article)
 
  1.  News article 
  2.  article
  3.  article
  4.  Reportage
  5.  an article in a newspaper
  6.  News article
  7.  Journalistic

Web Page [46] http://www.standards.dfes.gov.uk/primary/publications/mathematics/springboard_6/

  Low Consistency in Label Assignments
 
  1.  List of educational material/teaching material 
  2.  lesson/search page/list of links with lessons
  3.  link collection? don't know
  4.  Lessons
  5.  an entry page to a lesson plans' section
  6.  Product information
  7.  Scientific, Content Delivery

Web Page [47] http://www.superpages.com/community_education/

  Low Consistency in Label Assignments
 
  1.  Index of a web catalogue 
  2.  search+ catalogue
  3.  link collection
  4.  Linklist
  5.  a section in a web directory
  6.  List of resources
  7.  Commercial/Promotional

Web Page [48] http://www.switchboard.com

  Medium Consistency in Label Assignments (search (page/engine))
 
  1.  Entry page of a yellow pages search engine 
  2.  search
  3.  online service
  4.  Search
  5.  an entry page in yellow pages
  6.  Search
  7.  User Input

Web Page [49] http://www.w3.org/WAI/WCAG1A-Conformance

  Low Consistency in Label Assignments
 
  1.  Guidelines 
  2.  short introduction
  3.  informative, don't know
  4.  Glossary
  5.  This document is not based on a genre. Or, it is a subgenre - like a legend key (an explanation of a particular sign)
  6.  Law
  7.  Official

Web Page [50] http://www.weather.com/mobile/wap.html

  Medium Consistency in Label Assignments (informational/information page)
 
  1.  Instructions 
  2.  instructional+informational
  3.  product page, promotion
  4.  Advertisment
  5.  a service information page
  6.  Product information
  7.  Commercial/Promotional

Comments

Retrieved from "http://www.webgenrewiki.org/index.php5/Case_Study:_Assigning_genre_labels_to_random_web_pages"

Case Study: Assigning genre labels to random web pages

From WebGenreWiki

Survey (See Comments and Results)

Comments

Views

Personal tools

Navigation

Search

Toolbox