My name is Ryosuke Unno. I participated in the LINE internship program in the summer of 2021. As a university student, I study the application of reinforcement learning in video games. During this internship I joined Data Engineering Team 3 of the Data Platform Department. In this article, I'll introduce the activities I was engaged in during this internship period. Background and issues Currently, the Data Platform Department operates large-scale Hadoop clusters which offer over 300PB of disk c
I am a data engineer at LINE Data Labs.
Hello, I'm Keiji Yoshida. I currently work as a data engineer at LINE Data Labs. In this posting, I'd like to share a few cases on data engineering software troubleshooting: Apache Hadoop YARN ResourceManager failover Apache Hadoop HDFS NameNode failover Apache Zeppelin Notebook scheduler issue Apache Zeppelin deadlock issue Apache Spark SQL performance issue Troubleshooting failover issue in Apache Hadoop YARN ResourceManager Let's start with the failover issue in
