I am a data engineer at LINE Data Labs.
Hello, I'm Keiji Yoshida. I currently work as a data engineer at LINE Data Labs. In this posting, I'd like to share a few cases on data engineering software troubleshooting: Apache Hadoop YARN ResourceManager failover Apache Hadoop HDFS NameNode failover Apache Zeppelin Notebook scheduler issue Apache Zeppelin deadlock issue Apache Spark SQL performance issue Troubleshooting failover issue in Apache Hadoop YARN ResourceManager Let's start with the failover issue in
This is Keiji Yoshida, a data engineer from LINE Data Labs. From 2017, our team has been working on building and providing a system where any Liner could access data of services they are involved in. Have you heard of LINE Data Labs? LINE Data Labs is a team supporting LINE services, with data; we expertise in collecting, processing, aggregating and analyzing data for each LINE service and provide our result to service members. About 50 members consisting of machine learning engineers, data scie