ilum/kyuubi repository overview

⁠Ilum Kyuubi

⁠Overview

The ilum/kyuubi image provides a powerful distributed gateway for serverless SQL queries, based on Apache Kyuubi 1.10.2. It is built upon the ilum/spark base image, ensuring seamless integration with Spark 3.5.7 and Delta Lake.

• Engine Support — native support for Spark and Trino engines
• Serverless SQL — optimized for multi-tenant JDBC/ODBC concurrency on Kubernetes
• Security — runs as a non-root user (kyuubi with UID 10009)
• Multi-arch support — built for linux/amd64 and linux/arm64

⁠TL;DR / Quick Start

# Run Kyuubi Server
docker run -d \
  --name ilum-kyuubi \
  -p 10009:10009 \
  -p 10099:10099 \
  ilum/kyuubi:<version>

For production deployments, integrating with the Ilum control plane and Kubernetes discovery is recommended.

⁠Supported Tags

• <version>: Apache Kyuubi 1.10.2 + Spark 3.5.7 + Delta Lake support

⁠Environment Variables

⁠Core Configuration

⁠Customizing Engines

Kyuubi engines (Spark/Trino) as well as the server itself can be configured via kyuubi-defaults.conf or spark-defaults.conf mounted into the configuration directory.

⁠Data Persistence (Volumes)

⁠Network Configuration

⁠Security

⁠Non-root Architecture

The image runs as user kyuubi (UID 10009). When mounting host volumes, ensure directories have appropriate permissions:

# On host
sudo chown -R 10009:0 /path/to/logs /path/to/work

⁠Secret Hygiene

CAUTION: Never pass sensitive credentials directly in environment variables!

Recommended methods:

1. Kubernetes Secrets — for mounting Kerberos keytabs or database credentials.
2. IAM Roles (IRSA) — use Kubernetes Service Accounts for cloud storage access within engines.

⁠Vulnerability Scanning

Before production deployment, scan the image:

# Trivy
trivy image ilum/kyuubi:<version>

⁠Building the Image

Run command from the docker/ilum-kyuubi directory:

docker buildx build \
  --platform linux/amd64,linux/arm64 \
  -t ilum/kyuubi:<version> \
  --push .

⁠Image Verification

⁠Layer Analysis (Dive)

dive ilum/kyuubi:<version>

⁠Software Bill of Materials (SBOM)

# Syft
syft ilum/kyuubi:<version> -o spdx-json > sbom.json

⁠Image Contents — Details

⁠Dockerfile Components

• Base: ilum/spark:3.5.7-delta
• Gateway: Apache Kyuubi 1.10.2
• Engines:
  • Spark (Pre-installed)
  • Trino (Connector included)
• Features: Beeline, Web UI, Kerberos support (krb5-user)

⁠Support and Feedback

• Issues: Bug Tracker⁠
• Documentation: Ilum Docs⁠
• Slack: Join our Community⁠