Janis Eccarius d3feb65eb3 fix(spark): increase worker cores to 4 to allow concurrent jobs ...

With SPARK_WORKER_CORES=1 and 2 workers the cluster has 2 total cores.
LiveDashboard holds both — batch jobs wait indefinitely. 4 cores per
worker gives 8 total, enough to run streaming + batch concurrently.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-06-17 00:41:49 +02:00

..

base

fix(spark): increase worker cores to 4 to allow concurrent jobs

2026-06-17 00:41:49 +02:00

eu-central-1-prod

feat(spark): deploy persistent Spark cluster with Web UI

2026-06-15 22:41:33 +02:00