Janis Eccarius d3feb65eb3 fix(spark): increase worker cores to 4 to allow concurrent jobs ...

With SPARK_WORKER_CORES=1 and 2 workers the cluster has 2 total cores.
LiveDashboard holds both — batch jobs wait indefinitely. 4 cores per
worker gives 8 total, enough to run streaming + batch concurrently.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-06-17 00:41:49 +02:00

..

charts/spark-9.2.10/spark

feat(spark): deploy persistent Spark cluster with Web UI

2026-06-15 22:41:33 +02:00

history-server.yaml

fix(spark): replace shared spark-events PVC with emptyDir to fix Multi-Attach error

2026-06-16 20:33:48 +02:00

ingress.yaml

fix(spark): use nginx ingress class instead of traefik

2026-06-16 20:42:14 +02:00

kustomization.yaml

feat(spark): replace Bitnami chart with Apache Spark manifests

2026-06-16 19:48:51 +02:00

master.yaml

fix(spark): replace shared spark-events PVC with emptyDir to fix Multi-Attach error

2026-06-16 20:33:48 +02:00

pvc.yaml

fix(spark): replace shared spark-events PVC with emptyDir to fix Multi-Attach error

2026-06-16 20:33:48 +02:00

workers.yaml

fix(spark): increase worker cores to 4 to allow concurrent jobs

2026-06-17 00:41:49 +02:00