You can easily spin up the playground environment by docker compose. The environment consist of
- Spark Iceberg for Iceberg data initialisation through Spark
- Rest Iceberg Catalog for storing Iceberg metadata
- Minio as an object storage that is S3 compatible.
- Jupyter notebook with preinstalled Duckberg to run examples and experiments
Start the environment by
docker-compose up -d
The initial run could take additional time for jupyter docker image build. Then you can access
Once all the containers have been initiated run the Spark Iceberg Jupyter notebook that will init the Iceberg data and catalog.
Navigate to localhost:8888. Then select example Jupyter notebook you want to run and enjoy Duckberg!