Machine Learning Meets Natural Language Processing - The Story so Far

Natural Language Processing (NLP) has evolved significantly over the last decade. This paper highlights the most important milestones of this period, while trying to pinpoint the contribution of each individual model and algorithm to the overall progress. Furthermore, it focuses on issues still remaining to be solved, emphasizing on the groundbreaking proposals of Transformers, BERT, and all the similar attention-based models.

Keywords

Domains

Computer Science [cs]

Fichier principal

509922_1_En_53_Chapter.pdf (227.48 Ko)

Origin	Files produced by the author(s)
licence	CC BY 4.0 - Attribution

Connect in order to contact the contributor

https://inria.hal.science/hal-03287671

Submitted on : Thursday, July 15, 2021-6:10:19 PM

Last modification on : Monday, August 5, 2024-3:32:05 PM

Long-term archiving on : Saturday, October 16, 2021-7:04:41 PM

Dates and versions

hal-03287671 , version 1 (15-07-2021)

Licence

CC BY 4.0 - Attribution

Identifiers

HAL Id : hal-03287671 , version 1
DOI : 10.1007/978-3-030-79150-6_53

Cite

Nikolaos-Ioannis Galanis, Panagiotis Vafiadis, Kostas-Gkouram Mirzaev, George A. Papakostas. Machine Learning Meets Natural Language Processing - The Story so Far. 17th IFIP International Conference on Artificial Intelligence Applications and Innovations (AIAI), Jun 2021, Hersonissos, Crete, Greece. pp.673-686, ⟨10.1007/978-3-030-79150-6_53⟩. ⟨hal-03287671⟩