Notice: Function _load_textdomain_just_in_time was called incorrectly. Translation loading for the becustom domain was triggered too early. This is usually an indicator for some code in the plugin or theme running too early. Translations should be loaded at the init action or later. Please see Debugging in WordPress for more information. (This message was added in version 6.7.0.) in /home4/joyplace/public_html/wp-includes/functions.php on line 6114
Notice: Function _load_textdomain_just_in_time was called incorrectly. Translation loading for the wordpress-seo domain was triggered too early. This is usually an indicator for some code in the plugin or theme running too early. Translations should be loaded at the init action or later. Please see Debugging in WordPress for more information. (This message was added in version 6.7.0.) in /home4/joyplace/public_html/wp-includes/functions.php on line 6114
Warning: Cannot modify header information - headers already sent by (output started at /home4/joyplace/public_html/wp-includes/functions.php:6114) in /home4/joyplace/public_html/wp-includes/rest-api/class-wp-rest-server.php on line 1893
Warning: Cannot modify header information - headers already sent by (output started at /home4/joyplace/public_html/wp-includes/functions.php:6114) in /home4/joyplace/public_html/wp-includes/rest-api/class-wp-rest-server.php on line 1893
Warning: Cannot modify header information - headers already sent by (output started at /home4/joyplace/public_html/wp-includes/functions.php:6114) in /home4/joyplace/public_html/wp-includes/rest-api/class-wp-rest-server.php on line 1893
Warning: Cannot modify header information - headers already sent by (output started at /home4/joyplace/public_html/wp-includes/functions.php:6114) in /home4/joyplace/public_html/wp-includes/rest-api/class-wp-rest-server.php on line 1893
Warning: Cannot modify header information - headers already sent by (output started at /home4/joyplace/public_html/wp-includes/functions.php:6114) in /home4/joyplace/public_html/wp-includes/rest-api/class-wp-rest-server.php on line 1893
Warning: Cannot modify header information - headers already sent by (output started at /home4/joyplace/public_html/wp-includes/functions.php:6114) in /home4/joyplace/public_html/wp-includes/rest-api/class-wp-rest-server.php on line 1893
Warning: Cannot modify header information - headers already sent by (output started at /home4/joyplace/public_html/wp-includes/functions.php:6114) in /home4/joyplace/public_html/wp-includes/rest-api/class-wp-rest-server.php on line 1893
Warning: Cannot modify header information - headers already sent by (output started at /home4/joyplace/public_html/wp-includes/functions.php:6114) in /home4/joyplace/public_html/wp-includes/rest-api/class-wp-rest-server.php on line 1893
{"id":1693,"date":"2021-01-25T06:00:43","date_gmt":"2021-01-25T12:00:43","guid":{"rendered":"https:\/\/www.bigdatainrealworld.com\/?p=1693"},"modified":"2023-02-19T07:31:58","modified_gmt":"2023-02-19T13:31:58","slug":"how-to-control-log-settings-in-spark-and-stop-info-messages","status":"publish","type":"post","link":"https:\/\/www.bigdatainrealworld.com\/how-to-control-log-settings-in-spark-and-stop-info-messages\/","title":{"rendered":"How to control log settings in Spark and stop INFO messages?"},"content":{"rendered":"Spark spits out a lot of INFO messages in the logs. These messages stand in the way when you are troubleshooting an error and looking for error messages in the logs.<\/p>\n
Here is an example of log messages that you might see on the console or in the log.<\/span><\/p>\n20\/10\/10 10:12:03 INFO SparkEnv: Registering BlockManagerMaster\r\n20\/10\/10 10:12:03 INFO DiskBlockManager: Created local directory at \/tmp\/spark-local-201201010101203-xyik\r\n20\/10\/10 10:12:03 INFO MemoryStore: MemoryStore started with capacity 0.0 B.\r\n20\/10\/10 10:12:03 INFO ConnectionManager: Bound socket to port 44728 with id = ConnectionManagerId(10.1.100.12,44728)\r\n20\/10\/10 10:12:03 INFO BlockManagerMaster: Trying to register BlockManager\r\n20\/10\/10 10:12:03 INFO BlockManagerMasterActor$BlockManagerInfo: Registering block manager 10.1.100.12:44728 with 100.0 B RAM\r\n20\/10\/10 10:12:03 INFO BlockManagerMaster: Registered BlockManager\r\n20\/10\/10 10:12:03 INFO HttpServer: Starting HTTP Server\r\n20\/10\/10 10:12:03 INFO HttpBroadcast: Broadcast server started<\/pre>\n