Imply Videos

Dec 9, 2022

The present and future of compaction in Druid

Compaction in the Druid database has been evolving into use cases beyond improving query performance and reducing storage. This talk will first go over what is compaction, current use cases for compaction, a beginner’s guide on setting up compaction (and automatic compaction), and common pitfalls when setting up auto-compaction. The talk will then drive into short and long term plans for compaction in Druid. Future features include creating derived datasources / materialized views and automatically changing or maintaining different schemas for the same datasource based on the age of data.