Ilum

ILUM Core: Spark orchestration platform for Kubernetes (REST API, Livy, HA)

ILUM UI: web service for Spark orchestration and data lineage (Kubernetes, SQL)

DEPRECATED: Livy API proxy for Ilum (replaced by ilum-core 6.6.0+)

ILUM Airflow: workflow orchestration for Spark on Kubernetes (Livy, dbt)

ILUM Spark: hardened Spark images with cloud connectors, Delta Lake, and security-first DHI variant

ILUM Spark Launcher: Spark client for CI/CD pipelines (AWS, GCS, Azure)

ILUM Sparkmagic: Jupyter for remote Spark development (Livy, SSH, AI-powered)

ILUM Kyuubi: serverless SQL gateway for Spark and Trino (JDBC, Kubernetes)

ILUM Marquez Web: data lineage visualization UI (React, OpenLineage)

ILUM Hive: Apache Hive Metastore & HiveServer2 with cloud connectors (S3, GCS, Azure) for Spark

ILUM Mage AI: data pipeline platform with PySpark integration (orchestration)

ILUM Marquez: metadata service for data lineage (OpenLineage, GraphQL)

ILUM Superset: BI dashboards with Spark, Trino, ClickHouse connectors (Kyuubi, OIDC)