SHS Spark History Server is the web UI for completed and running Spark applications.
This chart uses AWS K8s IRSA technology to authenticate against AWS, so a proper ServiceAccount
needs to be specified in order to have the right permissions accessing application logs S3 bucket.
To install the chart:
helm install --set app.S3logPath=yourBucketName/eventLogFoloder
Minimum required variables are:
Parameter | Required | Description | Example |
---|---|---|---|
S3logPath |
yes |
S3 bucket and key used as base directory for Spark Application logs | mybucket/logs |
serviceAccount.name |
yes |
Service account used to run the deployment. Needs to have the appropiate IRSA role associated in order to access S3 | sparkSA |