Posted On: Aug 5, 2020
You can now access Persistent Application User Interfaces including Spark History Server, YARN Timeline Server, and Tez UI from the Amazon EMR console in Amazon Web Services China (Beijing) Region, operated by Sinnet, and Amazon Web Services China (Ningxia) Region, operated by NWCD.
The native YARN (resource scheduler), Tez (big data framework), and Spark (analytics engine) are used to debug distributed applications by overlaying the logs to the execution context and presenting an intuitive UI. However, you need to go through multiple steps in order to view the web interfaces on the master node of your EMR cluster for security reasons. Moreover, the UI will not be available if the cluster is terminated. We now persist the Spark History Server, YARN Timeline Server and Tez User Interface along with the event and container logs outside the cluster to simplify the debugging and monitoring.
To get started with Spark History Server, YARN Timeline Server and Tez UI, please visit Amazon Web Services Management Console.
Persistent Spark History Server is available on EMR Release 5.25 or later, and Persistent YARN Timeline Server and Tez UI are available on EMR Release 5.30.1 or later.