How to log in Apache Spark - Hacker Noon
https://hackernoon.com/how-to-log-in-apache-spark-f4204fad78a
Spark uses log4j as the standard library for its own logging. Everything that happens inside Spark gets logged to the shell console and to the configured underlying storage. Spark also provides a template for app writers so we could use the same log4j libraries to add whatever messageswe want to the existing and in place implementation of logging in Spark.
Spark uses log4j as the standard library for its own logging. Everything that happens inside Spark gets logged to the shell console and to the configured underlying storage. Spark also provides a template for app writers so we could use the same log4j libraries to add whatever messageswe want to the existing and in place implementation of logging in Spark.
DA: 89 PA: 93 MOZ Rank: 35