At Atlassian, our mission is to unleash the potential of every team, and the Confluence Big Data Platform team harnesses Druid to do just that. Join us to learn how we have integrated Druid into our platform to effortlessly serve millions of queries per day at sub-second latency, all while seamlessly ingesting gigabytes of data every hour through our ever resilient army of Kinesis streams. You’ll be witnessing firsthand how we effectively tune our clusters to handle our platform’s large scale as well as how we architected an entirely separate Druid cluster to proactively prepare for traffic. Step into our world of engineering big data and see how we use every feature Druid has to offer to optimize our production queries so that our users can enjoy analytics features without looking at loading animations.
Speakers:
– Julien Calfayan, Software Engineer – Confluence AI and Big Data Platform, Atlassian
– Gautam Jethwani, Software Engineer – Confluence AI and Big Data Platform, Atlassian
Atlassian’s presentation at the Druid Summit, led by Julian Calfayan and Gautam Jethwani, explored how Apache Druid powers analytics and user experiences in Confluence. Their talk covered the data pipeline from user events to insights, feature optimization, and load testing.
[Timestamp] Table of Contents:
[0:00] Introductions
[2:40] Key Stats: 1.8TB / 11,214 Segments / 11 Regions
[3:25] Events in Druid: Popular Feed, Following Feed, Page Analytics, Instance & Space Analytics, Platform
[5:55] Journey of Druid Data at Atlassian
[10:10] Final Goal: Increasing Meaningful Collaboration
[14:10] Scaling Druid is not a Guessing Game (Julian enters as speaker)
[17:14] Outcomes
Keynote: Powering Event-Driven Data with Apache Druid
The distinction between OLTP and OLAP is becoming less relevant as data architectures shift toward entities and events. In this session, we’ll delve into how Apache Druid’s event-first approach synthesizes...
Watch nowClosing Keynote: Charting the Future of Druid
What lies ahead for Apache Druid? Join us as we explore the evolving landscape of Druid’s query and storage engines, and how they are positioned to address the biggest challenges in event data for the future. Speaker: Gian...
Watch nowSalesforce: Tracing Service Dependencies at Scale with Druid and Flink
At Salesforce, we manage approximately 300 million distributed spans to infer service dependencies. We have successfully utilized a combination of Druid and Flink to handle this scale with high availability....
Watch now