Blog - LINE ENGINEERING

TAG ARCHIVES: Data/AI

Fixing issues we've faced while migrating from HiveQL to Spark SQL
Woo-yeong Jeong2023-09-26
A data engineer at LINE.
Hello. I'm Woo-yeong Jeong, a data engineer from the LINE Plus Messaging Data Eng Dev (NP) team. Recently, I've been working on a task to migrate HiveQL (Hive SQL) jobs to Spark SQL. I primarily used the SQL statement INSERT OVERWRITE TABLE to load data. However, depending on the Spark settings, several issues occurred that did not happen in Hive. In this article, I will introduce what I learned in the process of finding the cause and solution. This article will first introduce the backgrou
- Data/AI
A new challenge for LINE Timeline - 1
Kyoungbok Lee2020-05-13
I am a senior developer working on our Social Platform
Foreword A feature called "Discover" (known as "Explorer" in regions outside of Japan) and a new subscription model called "Follow" have been added to the LINE Timeline service. Although users are familiar with these features, we ended up writing this post because we wanted to share the parts that we had considered and made efforts on within these features. Starting with this introduction, we have planned a three-part series to bring you more detailed information. LINE Timeline's New Ch
- Server-side
- Data/AI
How we developed and integrated 'share' module into LINE app - 2
Hyeonji Jo / Keonhong Lee2020-05-11
Responsible for LINE iOS development
Introduction In Part I, we defined the following six categories to share our experience, difficulties and solutions of the Share module development for LINE iOS and covered the first two categories. Integrating conventions on data models Integrating logic on sharing data Identifying a list of eligible services Providing customized/additional actions Generalizing exceptions Improving UI/UX In this Part II, we will cover the remaining four categories. We will continue ou
- iOS
- Data/AI
How we developed and integrated 'share' module into LINE app - 1
Hyeonji Jo / Keonhong Lee2020-05-11
Responsible for LINE iOS development
Hi, there! We are Hyeonji Jo and Keonhong Lee, responsible for LINE iOS client development. Here we'd like to share our experience during the development of the Share module development on LINE for iOS, focusing on the difficulties we faced and how we overcame them. Overview: Share module The LINE app offers various services such as Chats, Album, Notes, Timeline and Keep, allowing users to freely upload and view posts, images or videos. In addition, the LINE app supports
- iOS
- Data/AI
Introducing LINE Games analytics environment
myunghoon yi2019-05-13
Big data and data analysis have long been popular key words in the IT world. Nowadays, they are no longer a choice but a necessity. Everyone is piling up and digging up data to find a meaning from big data. To achieve success in this "fact-finding" process, we need an appropriate analytics environment. Today I'd like to share with you how and what LINE has built for game analysis.LINE Games: Analytics environmentWhen it comes to an analytics environment, it means tools such as&nbs
- LINE Games
- Data/AI
Data system opens its doors to all Liners
Keiji Yoshida2018-08-29
I am a data engineer at LINE Data Labs.
This is Keiji Yoshida, a data engineer from LINE Data Labs. From 2017, our team has been working on building and providing a system where any Liner could access data of services they are involved in. Have you heard of LINE Data Labs? LINE Data Labs is a team supporting LINE services, with data; we expertise in collecting, processing, aggregating and analyzing data for each LINE service and provide our result to service members. About 50 members consisting of machine learning engineers, data scie
- Data Labs
- Data/AI
BigDB - an ad data pipeline for LINE
Jongkyu Lim, Joonghoon Shin2017-07-11
Jongkyu Lim: Jongkyu Lim is responsible for processing ads data. Joonghoon Shin: Joonghoon Shin develops ads data platform in LINE.
Before we begin Hello, we are Jongkyu Lim and Joonghoon Shin responsible for processing of ads data and development of ads platform in LINE.In this blog post, I'd like to talk about BigDB: a big data processing pipeline for LINE ads. I'll go into detail about how BigDB came to be, what BigDB is, how it's structured, what it does, and what use cases it has. How BigDB came to be As we gather data from various services that are growing in size, the size of the data grows larger as well, making it d
- Data/AI

1