How to open Spark UI when working on a server?

spark-shell always starts a web UI on port 4040 by default. If the server has no graphical interface, you can either use a text-based browser, such as Links, or access port 4040 from another machine, such as your laptop. You may need to run ufw allow 4040 to unblock the port in the firewall.


I think a python should be running on the server, so you can use this command:

python -m webbrowser -n http://host:port

(for example the application detail ui: http://localhost:4040). It gives a shell based browser if the server has no graphical interface

Tags:

Apache Spark