Automatic Selection of Parallel Data for Machine Translation - Artificial Intelligence Applications and Innovations (AIAI 2018)
Conference Papers Year : 2018

Automatic Selection of Parallel Data for Machine Translation

Despoina Mouratidis
  • Function : Author
  • PersonId : 1033567
Katia Lida Kermanidis
  • Function : Author
  • PersonId : 992337

Abstract

Nowadays machine translation is widely used, but the required data for training, tuning and testing a machine translation engine is often not sufficient or not useful. The automatic selection of data that are qualitatively appropriate for building translation models can help improve translation accuracy. In this paper, we used a large parallel corpus of educational video lecture subtitles as well as text posted by students and lecturers on the course fora. The text is quite challenging to translate due to the scientific domains involved and its informal genre. We applied a random forest classification schema on the output of three machine translation models (one based on statistical machine translation and two on neural machine translation) in order to automatically identify the best output. The unorthodox language phenomena observed as well as the rich-in-terminology scientific domains addressed in the educational video lectures, the language-independent nature of the approach, and the tackled three-class classification problem constitute innovative challenges of the work described herein.
Fichier principal
Vignette du fichier
468652_1_En_14_Chapter.pdf (349.1 Ko) Télécharger le fichier
Origin Files produced by the author(s)
Loading...

Dates and versions

hal-01821299 , version 1 (22-06-2018)

Licence

Identifiers

Cite

Despoina Mouratidis, Katia Lida Kermanidis. Automatic Selection of Parallel Data for Machine Translation. 14th IFIP International Conference on Artificial Intelligence Applications and Innovations (AIAI), May 2018, Rhodes, Greece. pp.146-156, ⟨10.1007/978-3-319-92016-0_14⟩. ⟨hal-01821299⟩
89 View
96 Download

Altmetric

Share

More