feat(analytics): add Spark batch analytics module

New standalone modules:analytics submodule with two Spark jobs:

- OpeningBookJob: reads game_records.pgn, extracts first N plies using
  pure Catalyst SQL expressions (no UDFs), aggregates win/draw/loss rates
  per opening sequence, writes Parquet + CSV top-1000 summary.

- PlayerStatsJob: unions each game into a player-centric view, aggregates
  total_games/wins/losses/draws/avg_move_count/win_rate per player_id,
  writes Parquet.

Module uses Scala 3 calling spark-sql_2.13 via JVM binary compatibility
(DataFrame API only; no spark.implicits._ / typed Datasets). Spark is
compileOnly; the fat jar bundles only scala3-library + postgresql driver.
Submit via spark-submit; see build.gradle.kts header for invocation.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

This commit is contained in:

Janis Eccarius

2026-06-15 21:58:05 +02:00

parent 0a5a216032

commit 259b3bbb24

5 changed files with 271 additions and 0 deletions

									
										settings.gradle.kts
									
		+1
		
												View File
												
				@@ -27,4 +27,5 @@ include(

				    "modules:store",

				    "modules:coordinator",

				    "modules:tournament",

				    "modules:analytics",

				)