Abstract
The Arabic Treebank (ATB) Project at the Linguistic Data Consortium (LDC) has embarked on a large corpus of Broadcast News (BN) transcriptions, and this has led to a number of new challenges for the data processing and annotation procedures that were originally developed for Arabic newswire text (ATB1, ATB2 and ATB3). The corpus requirements currently posed by the DARPA GALE Program, including English translation of Arabic BN transcripts, word-level alignment of Arabic and English data, and creation of a corresponding English Treebank, place significant new constraints on ATB corpus creation, and require careful coordination among a wide assortment of concurrent activities and participants. Nonetheless, in spite of the new challenges posed by BN data, the ATB's newly improved pipeline and revised annotation guidelines for newswire have proven to be robust enough that very few changes were necessary to account for the new genre of data. This paper presents the points where some adaptation has been necessary, and the overall pipeline as used in the production of BN ATB data.
| Original language | English (US) |
|---|---|
| Title of host publication | Proceedings of the 7th International Conference on Language Resources and Evaluation, LREC 2010 |
| Editors | Daniel Tapias, Irene Russo, Olivier Hamon, Stelios Piperidis, Nicoletta Calzolari, Khalid Choukri, Joseph Mariani, Helene Mazo, Bente Maegaard, Jan Odijk, Mike Rosner |
| Publisher | European Language Resources Association (ELRA) |
| Pages | 2117-2122 |
| Number of pages | 6 |
| ISBN (Electronic) | 2951740867, 9782951740860 |
| State | Published - 2010 |
| Event | 7th International Conference on Language Resources and Evaluation, LREC 2010 - Valletta, Malta Duration: May 17 2010 → May 23 2010 |
Publication series
| Name | Proceedings of the 7th International Conference on Language Resources and Evaluation, LREC 2010 |
|---|
Other
| Other | 7th International Conference on Language Resources and Evaluation, LREC 2010 |
|---|---|
| Country/Territory | Malta |
| City | Valletta |
| Period | 5/17/10 → 5/23/10 |
Funding
This work was supported in part by the Defense Advanced Research Projects Agency, GALE Program Grant No. HR0011-06-1-0003. The content of this paper does not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.
ASJC Scopus subject areas
- Education
- Library and Information Sciences
- Linguistics and Language
- Language and Linguistics