Blog - LINE ENGINEERING

TAG ARCHIVES: AI

An overview of 2018 language models
Tung Nguyen2019-01-16
I became a deep learning enthusiast the first time I read about Deep Belief Network in 2013. Currently, I am working on NLP for Clova, but I also interested in multimodal learning, reinforcement learning, and both research and development of production system.
Hello, this is Tung from Clova team. Clova is our AI platform that comes with the first generation smart devices as Clova Friends and Clova Wave. You can find more information on the products here (Sorry, the site is in Japanese). Today, as we start 2019, I want to invite you to reflect on a very hot topic of 2018 — the emergence of multiple competitive language models, ELMo, ULMFit, OpenAI Transformer, and BERT. There are articles on the int
- AI
- NLP
- language models
- LSTM
- Transfer

1