VMware NSX Intelligence is a distributed analytics platform powered by Druid that can process and visualize network traffic flows, detect anomalous network behaviors, and recommend security policies. We will introduce our data pipeline (Kafka, Spark, Druid), how we ingest and store data with Druid, how we perform different kind of queries to achieve our use cases, and our learnings in the past 3 years.
FJ Yang, Founder & CEO of Imply spoke at Data Driven NYC in June 2019. He shared the history of Apache Druid, a new type of database that he co-authored. He also introduced the concept of data rivers—the notion that data is never static, but rather flows and evolves over time. This idea relates back to the time series component of Druid.
Data Driven NYC is a monthly event covering Big Data and data-driven products and startups, hosted by Matt Turck (FirstMark Partner) and Jack Cohen (Platform) at FirstMark Capital.