Nov 20, 2020

Innowatts: Analyzing electric meters using Druid

Innowatts creates insights based on a variety of data sources. Of course, insight reliability depends on data quality. In the early days we would run spark clusters to discover odd values. We would repeat this process until the issues with the data were solved. As the number of clients, meters, and product offerings increased so did the cost.

In this talk I’ll go over how we use druid to power visualizations that users can interactively explore, shortening the time it takes to diagnose data, and off-loading Spark. I’ll also talk about how we use Plywood with Druid to discover missing, unrecognized, and divergent metrics.