Janis Eccarius
1b75466b3e
fix(spark): cap executor cores to prevent job starvation
Spark standalone gives executors all worker cores by default.
LiveDashboard was consuming all 8 cores (2 workers x 4 cores).
- streaming: spark.executor.cores=1 (uses 1 core total)
- batch jobs: spark.executor.cores=2 (uses 4 cores total, 2 per executor)
Leaves headroom for concurrent streaming + batch.
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-06-17 00:44:16 +02:00
..
2026-06-17 00:44:16 +02:00
2026-06-15 22:25:28 +02:00
2026-06-15 22:25:28 +02:00
2026-06-15 22:25:28 +02:00
2026-06-15 22:25:28 +02:00
2026-06-17 00:44:16 +02:00