Roblox built a cost-effective analytics solution using Druid to serve millions of experiences on our platform. This system provides free analytics to all creators, handling games ranging from 1 to 100 million monthly active users. Our approach heavily utilizes approximation techniques to manage scale and cost. This talk will cover our year-long journey with this system in production, focusing on key optimizations we’ve implemented.
Speaker:
Willis Kennedy, Senior Software Engineer, Roblox
[Timestamp] Table of Contents:
[0:00] Introduction to Roblox and Creator Analytics
[2:00] Roblox’s Data Infrastructure Overview
[3:00] Creator Analytics Features and Data Served
[4:00] Key Design Goals for Performance and Cost-Efficiency
[5:00] Approximation Techniques with Data Sketches
[7:00] Load Testing and Benchmarking with Druid
[9:00] Challenges with High Cardinality and Query Patterns
[12:00] Average Case Query Optimizations
[15:00] Practical Roll-Up Table Optimizations
[18:00] Cluster Setup and Query Management
[21:00] Data Ingestion and Workflow Management
[22:00] Outcomes and Future Plans
Imply Lumi Loglake Demo
In this demo, you'll see exactly how teams are using Lumi to do more with Splunk and modern observability stacks — without replatforming. We'll also give you a first look at Lumi Loglake — our newest feature...
Watch nowImply Lumi Observability Warehouse Demo
In this 30-minute session, you'll see a demo of Imply Lumi — the observability data layer built to help you store more, search faster, and reduce cost without changing your existing tools.
Watch nowLunch & Learn: Imply Lumi Observability Warehouse Demo
In this 30-minute session, you'll see a demo of Imply Lumi — the observability data layer built to help you store more, search faster, and reduce cost without changing your existing tools.
Watch now