Real-Time Identification of Parallel Texts from Bilingual Newsfeed

Nadeau, David and Foster, George (2004) Real-Time Identification of Parallel Texts from Bilingual Newsfeed. [Conference Paper]

Full text available as:



Parallel texts are documents that present parallel translations. This paper describes a simple method that can be deployed on a real-time news feed to create an infinitely growing source of parallel texts in French and English. Our experiment was lead on the Canada Newswire news feed. Given some of its intrinsic properties, it was possible to deploy a relatively simple text matching techniques that rely on language independent cognates such numbers, capitalized words, punctuation and new lines characters. On three week of press releases, our system correctly identified the vast majority of parallel press release. It committed only minor errors on repeated news items.

Item Type:Conference Paper
Keywords:parallel corpus, machine translation,
Subjects:Computer Science > Language
ID Code:4397
Deposited By: Nadeau, David
Deposited On:19 Jun 2005
Last Modified:11 Mar 2011 08:56

References in Article

Select the SEEK icon to attempt to find the referenced article. If it does not appear to be in cogprints you will be forwarded to the paracite service. Poorly formated references will probably not work.

Ma, Xiaoyi, and Liberman, Mark, Y., 1999, BITS: A Method for Bilingual Text Search over the Web, in Machine Translation Summit VII, September.

Resnik, Philip, and Smith, Noah, A., 2003, The Web as a Parallel Corpus, in Computational Linguistics, Special Issue on the Web as Corpus, 29 (3), pp. 349-380

Simard, M., Foster, G. and Isabelle, P., 1992, Using Cognates to Align Sentences in Bilingual Corpora, in Proceedings of the Fourth International Conference on Theoretical and Methodogical Issues in Machine translation, Montreal, pp. 67-81.


Repository Staff Only: item control page