ilum/livy-proxy
DEPRECATED: Livy API proxy for Ilum (replaced by ilum-core 6.6.0+)
10K+
ilum/livy-proxy repository overview
Ilum Livy Proxy
⚠️ DEPRECATED: This service is deprecated as of Ilum 6.6.0. Livy API functionality has been integrated into Ilum Core. Please migrate to ilum-core for continued support.
Deprecation Notice
Last Supported Version: 6.5.2-RC2
Replacement: Ilum Core now includes native Apache Livy 0.8.0 API compatibility. All Livy endpoints previously served by ilum-livy-proxy are available directly in ilum-core.
Migration Guide
For Existing Deployments
If you are currently using ilum/livy-proxy, follow these steps to migrate:
1. Upgrade to Ilum Core 6.6.0+
Replace ilum/livy-proxy with ilum/core in your Helm chart or Docker Compose:
# Before (deprecated)
image: ilum/livy-proxy:6.5.2-RC2
# After (recommended)
image: ilum/core:6.6.1
2. Update Endpoint Configuration
No API changes required — the Livy REST API remains compatible.
Update connection strings in your notebook tools:
| Tool | Old Endpoint | New Endpoint |
|---|---|---|
| Apache Zeppelin | http://ilum-livy-proxy:8998 | http://ilum-core:9888 |
| Jupyter (sparkmagic) | http://ilum-livy-proxy:8998 | http://ilum-core:9888 |
| Custom Livy clients | http://ilum-livy-proxy:8998 | http://ilum-core:9888 |
Note: Port changed from 8998 (Livy default) to 9888 (Ilum Core Livy endpoint).
3. Remove livy-proxy Deployment
Once migration is complete, remove the deprecated service:
# Kubernetes
kubectl delete deployment ilum-livy-proxy
# Docker Compose
docker-compose rm ilum-livy-proxy
Historical Overview
Original Purpose
ilum/livy-proxy served as an Apache Livy API compatibility layer, enabling seamless integration between notebook tools (Apache Zeppelin, Jupyter) and Ilum's Spark orchestration platform.
Key Features (Deprecated)
- Livy API Compatibility — Full implementation of Apache Livy REST API
- Session Management — Mapped Livy batches/sessions to Ilum internal jobs
- Notebook Integration — Zero-configuration support for Zeppelin and Jupyter
- Multi-Language — PySpark, Scala (Spark), and SparkR session support
Why Deprecated?
- Architecture Simplification — Eliminated separate proxy service
- Reduced Maintenance — Consolidated codebase into ilum-core
- Better Performance — Direct API access without proxy overhead
- Enhanced Features — ilum-core provides Livy 0.8.0 compatibility + additional Ilum-specific features
Legacy Documentation (v6.5.2-RC2)
WARNING: The following documentation is for historical reference only. Do not use for new deployments.
Last Supported Tags
6.5.2-RC2— Final release candidate6.5.1-RC1— Previous release
Environment Variables (Legacy)
| Variable | Description |
|---|---|
| ILUM_SERVICE_URL | Ilum service backend URL (default: http://ilum-service:8080) |
| SERVER_PORT | Livy proxy API port (default: 8998) |
Ports (Legacy)
| Port | Service |
|---|---|
8998 | Livy-compatible REST API |
Image Contents (Legacy)
- Base: ilum/java:17.0.11_9-jre
- Framework: Spring Boot 3.1.2
- Language: Kotlin 1.9
- User: ilum (UID 1001, non-root)
Support
For migration assistance or questions:
- Issues: Bug Tracker
- Documentation: Ilum Docs
- Slack: Join our Community
Tag summary
Content type
Image
Digest
sha256:9ce0b9ad5…
Size
426.9 MB
Last updated
2 months ago
docker pull ilum/livy-proxy:6.7.3