Failed driver state

[proton5000]

I have used your instruction from README.md
But I have met some issuses:

1. In a file docker-compose.yml - version: "3.7" is not support by docker-compose (I have changet it to the version: "3.3")

2. The some files are changed and do not match with your instruction from README.md file. For example: some versions are changed to the "latest".

After all I have started the cluster, but the spark-sublit option is not work:
I have used the script from spark-submit/crimes-app.sh, only changet it for my application.

log:

./crimes-app.sh
log4j:WARN No appenders could be found for logger (org.apache.hadoop.util.NativeCodeLoader).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
19/08/23 16:48:33 INFO SecurityManager: Changing view acls to: root
19/08/23 16:48:33 INFO SecurityManager: Changing modify acls to: root
19/08/23 16:48:33 INFO SecurityManager: Changing view acls groups to: 
19/08/23 16:48:33 INFO SecurityManager: Changing modify acls groups to: 
19/08/23 16:48:33 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(root); groups with view permissions: Set(); users  with modify permissions: Set(root); groups with modify permissions: Set()
19/08/23 16:48:33 INFO Utils: Successfully started service 'driverClient' on port 33063.
19/08/23 16:48:33 INFO TransportClientFactory: Successfully created connection to spark-master/172.19.0.2:7077 after 22 ms (0 ms spent in bootstraps)
19/08/23 16:48:33 INFO ClientEndpoint: Driver successfully submitted as driver-20190823164833-0002
19/08/23 16:48:33 INFO ClientEndpoint: ... waiting before polling master for driver state
19/08/23 16:48:38 INFO ClientEndpoint: ... polling master for driver state
19/08/23 16:48:39 INFO ClientEndpoint: State of driver-20190823164833-0002 is FAILED
19/08/23 16:48:39 INFO ShutdownHookManager: Shutdown hook called
19/08/23 16:48:39 INFO ShutdownHookManager: Deleting directory /tmp/spark-01a41054-33c9-49c6-9550-c1537854553a

Please help me to solve this issue.

[atillaSilva]

I had the same issue, the problem was related (in my case) to SparkContext("local[*]"), I changed SparkContext("local[*]") to SparkContext(), and it solved my problem