title: News Article Extraction with Template-Independent Wrapper
creator: Wang, Junfeng
creator: He, Xiaofei
creator: Wang, Can
creator: Pei, Jian
creator: Bu, Jiajun
creator: Chen, Chun
creator: Guan, Ziyu
creator: Gang, Lu
description: We consider the problem of template-independent news  extraction. The state-of-the-art news extraction method is based  on template-level wrapper induction, which has two serious  limitations. 1) It cannot correctly extract pages belonging to an  unseen template until the wrapper for that template has been  generated. 2) It is costly to maintain up-to-date wrappers for  hundreds of websites, because any change of a template may  lead to the invalidation of the corresponding wrapper. In this  paper we formalize news extraction as a machine learning  problem and learn a template-independent wrapper using a very  small number of labeled news pages from a single site. Novel  features dedicated to news titles and bodies are developed  respectively. Correlations between the news title and the news  body are exploited. Our template-independent wrapper can  extract news pages from different sites regardless of templates.  In experiments, a wrapper is learned from 40 pages from a  single news site. It achieved 98.1% accuracy over 3,973 news  pages from 12 news sites.  
date: 2009-04
type: Conference or Workshop Item
type: PeerReviewed
format: application/pdf
identifier: http://www2009.eprints.org/123/1/p1085.pdf
identifier: Wang, Junfeng <http://www2009.eprints.org/view/author/Wang=3AJunfeng=3A=3A.html> and He, Xiaofei <http://www2009.eprints.org/view/author/He=3AXiaofei=3A=3A.html> and Wang, Can <http://www2009.eprints.org/view/author/Wang=3ACan=3A=3A.html> and Pei, Jian <http://www2009.eprints.org/view/author/Pei=3AJian=3A=3A.html> and Bu, Jiajun <http://www2009.eprints.org/view/author/Bu=3AJiajun=3A=3A.html> and Chen, Chun <http://www2009.eprints.org/view/author/Chen=3AChun=3A=3A.html> and Guan, Ziyu <http://www2009.eprints.org/view/author/Guan=3AZiyu=3A=3A.html> and Gang, Lu <http://www2009.eprints.org/view/author/Gang=3ALu=3A=3A.html> (2009) News Article Extraction with Template-Independent Wrapper. In: 18th International World Wide Web Conference, April 20th-24th, 2009, Madrid, Spain.
relation: http://www2009.eprints.org/123/