creators_name: Nadeau, David creators_name: Foster, George creators_id: pythonner creators_id: type: confpaper datestamp: 2005-06-19 lastmod: 2011-03-11 08:56:05 metadata_visibility: show title: Real-Time Identification of Parallel Texts from Bilingual Newsfeed ispublished: pub subjects: comp-sci-lang full_text_status: public keywords: parallel corpus, machine translation, abstract: Parallel texts are documents that present parallel translations. This paper describes a simple method that can be deployed on a real-time news feed to create an infinitely growing source of parallel texts in French and English. Our experiment was lead on the Canada Newswire news feed. Given some of its intrinsic properties, it was possible to deploy a relatively simple text matching techniques that rely on language independent cognates such numbers, capitalized words, punctuation and new lines characters. On three week of press releases, our system correctly identified the vast majority of parallel press release. It committed only minor errors on repeated news items. date: 2004 date_type: published pagerange: 21-28 refereed: TRUE referencetext: Ma, Xiaoyi, and Liberman, Mark, Y., 1999, BITS: A Method for Bilingual Text Search over the Web, in Machine Translation Summit VII, September. Resnik, Philip, and Smith, Noah, A., 2003, The Web as a Parallel Corpus, in Computational Linguistics, Special Issue on the Web as Corpus, 29 (3), pp. 349-380 Simard, M., Foster, G. and Isabelle, P., 1992, Using Cognates to Align Sentences in Bilingual Corpora, in Proceedings of the Fourth International Conference on Theoretical and Methodogical Issues in Machine translation, Montreal, pp. 67-81. citation: Nadeau, David and Foster, George (2004) Real-Time Identification of Parallel Texts from Bilingual Newsfeed. [Conference Paper] document_url: http://cogprints.org/4397/1/NRC-48081.pdf