LINE Engineering
Blog

  • The next step for even safer messaging: Letter Sealing
    Shin Kibin 2016.08.12

    He is a LINE engineer working on the messaging server.

    In New generation of safe messaging: “Letter Sealing”, we announced that end-to-end encryption (E2EE) has been made available on LINE messages.

    But we've made even more improvements to safe messaging over the past few months, expanding Letter Sealing to features other than one-on-one chats. We'd like to share some of them here in this post.

    Letter Sealing

    Read More

  • Official LINE Developer Day 2016 website and registration form
    Kushii Yusuke 2016.08.08

    In charge of actively and creatively promoting the technologies of LINE both in and out of the company. Also in charge of operations of LINE Developer Day 2016.

    We've already announced LINE Developer Day 2016. Today, we're happy to announce that the official website and registration forms are also available.

    linedevday

    Read More

  • Applying CircuitBreaker to Channel Gateway
    Shin Jong Hun 2016.08.05

    I don’t like being inconvenienced. One of the focal points of my work is to reduce these inconveniences so I have more time to focus on what matters. I think that’s why I like programming. Although I can’t really figure out why I seem to be getting busier with time…

    Before reading

    If you have yet to read the introductory article to circuit breakers, I recommend you read the following article first: Circuit Breakers for distributed services

    Applying CircuitBreaker to Channel Gateway

    Channel Gateway servers provide various LINE server features to content providers. This is why Channel Gateway servers are highly affected by the servers they are connected to, with the effects easily spreading across all Channel Gateway servers.

    CircuitBreaker

    Read More

  • Report on Prometheus Casual Talks in Tokyo and then toward PromCon 2016
    Yukawa Wataru 2016.08.02

    He is a data engineer at LINE. He usually works with Hadoop, Hive, Presto, Azkaban, Fluentd, Elasticsearch, Prometheus, Grafana, and more.

    Introduction

    Hello, my name is Wataru Yukawa. I work at LINE as a data engineer.

    As a data engineer, my daily duties include using Fluentd to collect logs, Hadoop to accumulate, and Hive to aggregate and analyze logs. Our Hadoop cluster is medium-sized, consisting of 40 units and approximately 370TB of DFS used space. Data from LINE family apps is smaller compared to the LINE app. While it's nowhere near large enough to be considered as big data, it still has many types of different data, Fluentd tags, and over 400 Fluentd processes due to the various LINE family services tied to it. The Fluentd data flow amounts to 150 thousand messages per second during peak times.

    Read More

  • Introducing the LINE Game AirBorne DataCenter
    OH WANG JIN 2016.07.25

    He is a data engineer for the LINE Ads Platform. His main development areas are games, security and search and is currently working on the big data technology.

    Last time I posted an article titled, "Analyzing Large Amounts of Security Data with Spark, Mesos, Zeppelin, and HDFS." Today I will introduce how LINE applies cloud and stream processing technology to perform near-real-time processing on game data detected by AirArmor1.

    1: AirArmor is a security solution for mobile games developed by LINE.

    AirBorne DataCenter & Mesos (with DC/OS)

    To analyze security data, we built our own system named AirBorne DataCenter. The system uses Apache Mesos as its base framework. And to process big data efficiently, the system implements open source components such as Kafka, Spark, Elasticsearch, Hadoop, Zeppelin, and Spring.

    Read More