Aligning sentences in parallel corpora Export

@misc{citeulike:3576174, abstract = {In this paper we describe a statistical tech-nique for aligning sentences with their translations in two parallel corpora. In addition to certain anchor points that are available in our da.ta, the only information about the sentences that we use for calculating alignments is the number of tokens that they contain. Because we make no use of the lexical details of the sentence, the alignment com-putation is fast and therefore practical for appli-cation to very large collections of text. We have used this technique to align several million sen-tences in the English-French Hans\~{}trd corpora and have achieved an accuracy in excess of 99 \% in a random selected set of 1000 sentence pairs that we checked by hand. We show that even without the benefit of anchor points the correlation between the lengths of aligned sentences is strong enough that we should expect to achieve an accuracy of between 96 \% and 97\%. Thus, the technique may be applicable to a wider variety of texts than we have yet tried.}, author = {Brown, Peter F. and Lai, Jennifer C. and Nd}, citeulike-article-id = {3576174}, citeulike-linkout-0 = {http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.13.9705}, keywords = {alignment, parallel-corpora, summarisation, text-mining}, pages = {169--176}, posted-at = {2008-11-19 03:12:57}, priority = {2}, title = {Aligning sentences in parallel corpora}, url = {http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.13.9705}, year = {1991} }

TY - ELEC ID - citeulike:3576174 L3 - citeulike-article-id:3576174 N2 - In this paper we describe a statistical tech-nique for aligning sentences with their translations in two parallel corpora. In addition to certain anchor points that are available in our da.ta, the only information about the sentences that we use for calculating alignments is the number of tokens that they contain. Because we make no use of the lexical details of the sentence, the alignment com-putation is fast and therefore practical for appli-cation to very large collections of text. We have used this technique to align several million sen-tences in the English-French Hans~trd corpora and have achieved an accuracy in excess of 99 % in a random selected set of 1000 sentence pairs that we checked by hand. We show that even without the benefit of anchor points the correlation between the lengths of aligned sentences is strong enough that we should expect to achieve an accuracy of between 96 % and 97%. Thus, the technique may be applicable to a wider variety of texts than we have yet tried. EP - 176 TI - Aligning sentences in parallel corpora SP - 169 KW - alignment KW - parallel-corpora KW - summarisation KW - text-mining AU - Brown, Peter AU - Lai, Jennifer AU - Nd PY - 1991/// UR - http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.13.9705 ER -