Delta Lake is an open-source storage layer that brings reliability and performance to data lakes. In this session, we will explore the fundamentals of Delta Lake and demonstrate how to ingest Delta Lake tables into Apache Druid for sub-second query latency. Additionally, we’ll introduce a new upcoming feature in Apache Druid: scheduled batch supervisors, which can facilitate continuous data ingestion natively in Druid, ensuring that your Druid tables stay up-to-date with the latest data from Delta Lake or any input source.
Speakers:
– Abhishek Balaji Radhakrishnan, Staff Software Engineer, Imply
– Venki Korukanti, Software Engineer, Databricks
[Timestamp] Table of Contents:
Introduction
[0:00] Agenda
[1:17] Motivation
[3:21] Overview of Delta Lake
Integrating Delta Lake
[4:10] Delta Lake: How does it work?
[9:36] Advanced Delta Feature: Deletion Vector
[11:52] Delta Kernel
[14:35] Integration Architecture
[15:46] DML Query Example
[17:29] Scheduled Batch Ingestion
[20:05] Demo
[24:34] Roadmap
Imply Lumi Observability Warehouse Demo
In this 30-minute session, you'll see a demo of Imply Lumi — the observability data layer built to help you store more, search faster, and reduce cost without changing your existing tools.
Watch nowLunch & Learn: Imply Lumi Observability Warehouse Demo
In this 30-minute session, you'll see a demo of Imply Lumi — the observability data layer built to help you store more, search faster, and reduce cost without changing your existing tools.
Watch nowImply Lumi: What’s New, What’s Next — and How to Unlock More Observability Value Today
Observability teams must retain more data, investigate faster, and control costs without disrupting existing tools. This live Imply Lumi update shows new ingestion, retention, search, Splunk interoperability,...
Watch now