Apache Spark Init

Creator
Creator
Seonglae ChoSeonglae Cho
Created
Created
2024 May 4 8:19
Editor
Edited
Edited
2024 May 4 9:6
Refs
Refs
  1. Edit configs in config folder
    1. workers
    2. spark-env
  1. Run sbin services
    1. start-master.sh
      1. check spark url by accessing 8080 UI
    2. start-worker.sh spark url
 
 

Ports in usual

  • Master UI in 8080
  • Worker in 8081
  • History server in 18080
  • Spark server on 7077
 
 
 
 
 

 

Recommendations