Blog - LINE ENGINEERING

TAG ARCHIVES: Kafka

Kafka-based job queue library 'Decaton' examples
Kazuki Matsushita2020-12-10
Introduction: Decaton LINE recently released an in-house developed library, Decaton, as open source. Decaton is a Kafka-based asynchronous job queue library, and it is widely used throughout LINE. GitHub: line/decaton - High throughput asynchronous task processing on Apache Kafka In fact, Kafka offers Kafka Streams, its official library for processing streams. However, Kafka Streams did not meet our requirements at the time, and we decided to develop a Kafka-based library called Decat
- Kafka
- Decaton
Applying Kafka Streams for internal message delivery pipeline
Kawamura Yuto2016-08-18
He is an engineer working at LINE. He is in charge of developing and managing LINE's core data pipeline and storage which are built on top of some OSS technologies such as Apache Kafka
IntroductionHello, my name is Yuto Kawamura. I'm a LINE server engineer in charge of developing and operating LINE's core storage facilities such as HBase and Kafka.Since the latter half of last year, I've been working on a new project called IMF, which stands for Internal Message Flow (or Fund). IMF has two main goals:Develop a data pipeline which provides a unified way of delivering events between our systems.Replace talk-dispatcher, a component in the LINE server system responsible for backgr
- Kafka

1