dremio/dremio-oss repository overview

Dockerfile⁠ to build images. Github repo⁠ has helm charts to deploy Dremio to a Kubernetes cluster.

⁠Quick Reference

• Usage and deployment documentation⁠
• Visit our community site to ask questions or file issues⁠
• Lots of tutorials⁠

⁠Maintained by

• Dremio Corp⁠

⁠Commercial support & Enterprise Edition

• Dremio Enterprise Edition⁠

⁠What is Dremio?

Dremio is an easy and open lakehouse platform. Data teams use Dremio to deliver self-service analytics, while enjoying the flexibility to use Dremio's lightning-fast SQL engine and any other processing engine on the same data.

Dremio enables analysts to explore and visualize data with sub-second query response times, and enables data engineers to ingest and transform data directly in the data lake with full support for DML operations. In addition, analysts can join data in the lake with data in external databases, so they don't have to move data into object storage to derive value from that data. Dremio's open lakehouse platform, based on community-driven standards like Apache Iceberg and Apache Arrow, enables organizations to use best-in-class processing engines and eliminates vendor lock-in.

Dremio is also the co-creator of Apache Arrow, a platform for columnar in-memory processing. Arrow is used extensively by Dremio, and is core to many other open source projects. Read more about the origin & history of Apache Arrow⁠.

⁠Single Node Deployment

docker run -p 9047:9047 -p 31010:31010 -p 32010:32010 -p 45678:45678 dremio/dremio-oss

This includes a single node deployment that starts up a single daemon that includes:

• Embedded Zookeeper
• Master Coordinator
• Executor

⁠Distributed Deployment

Use published helm charts⁠ for a distributed deployment of Dremio in a Kubernetes environment.

⁠Dealing with name resolution in clusters

When having Dremio communicate information between nodes, you need to have Dremio use the name it registers in Zookeeper to be resolvable from other nodes. The easiest way to do this is to use IP addresses and set the following additional property: -Dregistration.publish-host=$LOCAL_CONTAINER_IP