 Janis
|
06e70a5e8a
|
feat(spark): add staging overlay, scale down prod
- spark-cluster/eu-central-1-staging: namespace nowchess-staging, ingress
patched to spark-st.* / spark-history-st.* with TLS + cert-manager
- spark-analytics/eu-central-1-staging: namespace nowchess-staging, image
pinned to 0.2.0, all CronJob + live-dashboard patches carried over
- eu-central-1/argo-apps: spark-cluster-staging + spark-analytics-staging
ArgoCD apps pointing at new staging overlays
- spark-cluster/eu-central-1-prod: scale spark-master and spark-worker to 0
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
|
2026-06-17 08:48:31 +02:00 |
|
 Janis Eccarius
|
eefa6e728a
|
feat(spark): deploy persistent Spark cluster with Web UI
- Add spark-cluster/base with Bitnami Spark chart 9.2.10 (master +
2 workers), spark-events PVC (RWO/local-path), and Ingress resources
for spark.nowchess.janis-eccarius.de (master UI) and
spark-history.nowchess.janis-eccarius.de (history placeholder)
- Add spark-cluster/eu-central-1-prod overlay and ArgoCD Application
(automated prune + selfHeal)
- Migrate all spark-analytics CronJobs and streaming Deployment from
K8s-native mode (k8s://...) to Spark standalone (spark://spark-master:7077);
drop kubernetes-specific --conf flags; add eventLog confs; mount
spark-events PVC on all job pods
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
|
2026-06-15 22:41:33 +02:00 |
|