NowChess/GitOps
4
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

fix(spark): raise driver.memory to 512m - Spark 4.x minimum is 450m

Browse Source
This commit is contained in:
Janis Eccarius
2026-06-17 01:20:31 +02:00
parent 54e0561b43
commit a0f96e9985
2 changed files with 8 additions and 8 deletions
Download Patch File Download Diff File Expand all files Collapse all files
spark-analytics/base/cronjobs.yaml
+4 -4
View File
@@ -38,7 +38,7 @@ spec:
- --conf - --conf
- spark.executor.memory=1g - spark.executor.memory=1g
- --conf - --conf
- spark.driver.memory=256m - spark.driver.memory=512m
- --class - --class
- de.nowchess.analytics.OpeningBookJob - de.nowchess.analytics.OpeningBookJob
- local:///app/analytics.jar - local:///app/analytics.jar
@@ -115,7 +115,7 @@ spec:
- --conf - --conf
- spark.executor.memory=1g - spark.executor.memory=1g
- --conf - --conf
- spark.driver.memory=256m - spark.driver.memory=512m
- --class - --class
- de.nowchess.analytics.PlayerStatsJob - de.nowchess.analytics.PlayerStatsJob
- local:///app/analytics.jar - local:///app/analytics.jar
@@ -191,7 +191,7 @@ spec:
- --conf - --conf
- spark.executor.memory=1g - spark.executor.memory=1g
- --conf - --conf
- spark.driver.memory=256m - spark.driver.memory=512m
- --class - --class
- de.nowchess.analytics.PlayerClusteringJob - de.nowchess.analytics.PlayerClusteringJob
- local:///app/analytics.jar - local:///app/analytics.jar
@@ -268,7 +268,7 @@ spec:
- --conf - --conf
- spark.executor.memory=1g - spark.executor.memory=1g
- --conf - --conf
- spark.driver.memory=256m - spark.driver.memory=512m
- --class - --class
- de.nowchess.analytics.PlayerGraphJob - de.nowchess.analytics.PlayerGraphJob
- local:///app/analytics.jar - local:///app/analytics.jar
spark-analytics/eu-central-1-prod/kustomization.yaml
+4 -4
View File
@@ -32,7 +32,7 @@ patches:
- --conf - --conf
- spark.executor.memory=200m - spark.executor.memory=200m
- --conf - --conf
- spark.driver.memory=256m - spark.driver.memory=512m
- --class - --class
- de.nowchess.analytics.OpeningBookJob - de.nowchess.analytics.OpeningBookJob
- local:///app/analytics.jar - local:///app/analytics.jar
@@ -64,7 +64,7 @@ patches:
- --conf - --conf
- spark.executor.memory=200m - spark.executor.memory=200m
- --conf - --conf
- spark.driver.memory=256m - spark.driver.memory=512m
- --class - --class
- de.nowchess.analytics.PlayerStatsJob - de.nowchess.analytics.PlayerStatsJob
- local:///app/analytics.jar - local:///app/analytics.jar
@@ -95,7 +95,7 @@ patches:
- --conf - --conf
- spark.executor.memory=200m - spark.executor.memory=200m
- --conf - --conf
- spark.driver.memory=256m - spark.driver.memory=512m
- --class - --class
- de.nowchess.analytics.PlayerClusteringJob - de.nowchess.analytics.PlayerClusteringJob
- local:///app/analytics.jar - local:///app/analytics.jar
@@ -127,7 +127,7 @@ patches:
- --conf - --conf
- spark.executor.memory=200m - spark.executor.memory=200m
- --conf - --conf
- spark.driver.memory=256m - spark.driver.memory=512m
- --class - --class
- de.nowchess.analytics.PlayerGraphJob - de.nowchess.analytics.PlayerGraphJob
- local:///app/analytics.jar - local:///app/analytics.jar