Janis 6351a19b67 feat(analytics): feed Lichess PGN dumps into Spark batch jobs ...

Add GameSource: normalises game records into a shared schema and
selects backend via NOWCHESS_PGN_PATH. Unset = PostgreSQL game_records
(unchanged); set = a Lichess PGN dump (file or http(s) URL).

- Parse Lichess PGN with Spark SQL string functions only (no UDFs).
- URLs fetched once via SparkContext.addFile, distributed to executors.
- .pgn.zst decompressed in-process via zstd-jni, plain .pgn redistributed.
- All four batch jobs read through GameSource and skip JDBC write-back
  in PGN mode (Parquet/CSV output only).

Enables driving the analytics demo straight from
https://database.lichess.org standard dumps.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

2026-06-17 10:40:29 +02:00

.claude

docs: add automated defect creation workflow guide

2026-06-06 15:31:33 +02:00

.codesight

fix: linter formatting and improve code readability

2026-05-14 10:47:40 +02:00

.devcontainer

feat: true-microservices (#40)

2026-04-29 22:06:01 +02:00

.github/workflows

chore(analytics): merge remote main — keep analytics module additions

2026-06-16 20:10:56 +02:00

.idea

ci(native-image): add x86_v2 arch to build matrix

2026-05-30 15:03:43 +02:00

ARABIAN CHESS

feat: NCS-25 Add linters to keep quality up (#27)

2026-04-12 20:58:39 +02:00

bruno

refactor(account): update time control structure and remove deprecated fields

2026-05-19 14:41:20 +02:00

docs

feat: NCS-82 add Swiss-system tournament module (#55)

2026-06-09 15:09:53 +02:00

gradle/wrapper

feat: true-microservices (#40)

2026-04-29 22:06:01 +02:00

jacoco-reporter

feat: true-microservices (#40)

2026-04-29 22:06:01 +02:00

modules

feat(analytics): feed Lichess PGN dumps into Spark batch jobs

2026-06-17 10:40:29 +02:00

.gitattributes

feat: NCS-25 Add linters to keep quality up (#27)

2026-04-12 20:58:39 +02:00

.gitignore

feat: NCS-121 pipeline for tournament (#68)

2026-06-09 23:50:51 +02:00

.scalafix.conf

feat: NCS-25 Add linters to keep quality up (#27)

2026-04-12 20:58:39 +02:00

.scalafmt.conf

feat: NCS-25 Add linters to keep quality up (#27)

2026-04-12 20:58:39 +02:00

add-a-new-microservice-ethereal-marshmallow.md

feat: true-microservices (#40)

2026-04-29 22:06:01 +02:00

AGENTS.md

feat: add initial project structure and documentation files (#24)

2026-04-12 16:39:17 +02:00

build.gradle.kts

feat(analytics): add Spark batch analytics module

2026-06-15 21:58:05 +02:00

CLAUDE.md

docs(claude): mandate NativeReflectionConfig registration for all serialized types

2026-06-05 11:00:45 +02:00

CLAUDE.original.md

feat: true-microservices (#40)

2026-04-29 22:06:01 +02:00

clean

feat: NCS-13 Implement Threefold Repetition (#31)

2026-04-16 18:49:20 +02:00

compile

refactor: NCS-22 NCS-23 reworked modules and tests (#17)

2026-04-06 09:07:39 +02:00

coverage

refactor: NCS-22 NCS-23 reworked modules and tests (#17)

2026-04-06 09:07:39 +02:00

gradle.properties

feat: NCS-37 Quarkus integration (#35)

2026-04-21 12:35:20 +02:00

gradlew

feat: add memory structure documentation and update index (#5)

2026-03-28 13:35:49 +01:00

gradlew.bat

chore: Initial Commit

2026-03-21 14:40:00 +01:00

lint

feat: NCS-53 changed IO to MicroService for easier scaling (#37)

2026-04-21 15:38:58 +02:00

settings.gradle.kts

feat(analytics): add Spark batch analytics module

2026-06-15 21:58:05 +02:00

test

feat(logging): add DEBUG/INFO/WARN logging across services (NCS-72) (#41)

2026-05-02 17:33:27 +02:00

S

Description

No description provided

1.3 GiB

Languages

Scala 83.6%

Python 12.1%

Bru 3%

HTML 0.8%

Shell 0.2%

Other 0.1%