Blog - LINE ENGINEERING

Yang Xu

Yang is an engineer on the Data Engineering 1 team.

Introducing Frey: LINE's new self-service batch ingestion system
Yang Xu2020-12-14
Yang is an engineer on the Data Engineering 1 team.
Hi, this is Yang Xu from Data Engineering 1 of the Data Platform department. Our department runs a huge Hadoop cluster and provides various services for data analysis, machine learning, and so on. One mission of our team is providing a batch ingestion service, which ingests data from different storages into our Hadoop environment for all of LINE products to meet their requirements for daily and hourly analysis. In this article, I would like to talk about solutions for batch ingestion and intro

1