Imply Polaris offers Druid-as-a-Service to users with the ability to pay for ingestion only when it is used. To achieve this and keep costs down, Druid needs to scale its ingestion resources in response to customer workloads. In this session, we will talk about how we deployed Apache Druid to provide this capability to our customers first using Druid’s in built auto-scaling ingestion mechanics and then by switching to middle manager less ingestion using the druid-kubernetes-overlord extension and Kubernetes node scaling In the talk, we will discuss some of the key problems we had to solve to make deploying middle manager less ingestion a success like minimizing pod startup time and tradeoffs to consider before switching to middle manager less ingestion.
Demo Video: Imply Polaris Overview
Imply Polaris is a cloud-native database-as-a-service that simplifies the developer experience by providing all the advantages of Apache Druid, plus auto-scaling for seamless data ingestion, enhanced security,...
Watch nowImply Polaris + Natural Intelligence: Powering Real-time Analytics & Observability
Imply Polaris provides the fastest path to real-time analytics by offering seamless data ingestion, auto-scaling capabilities, built-in visualization, and a secure, fully managed infrastructure. Watch this...
Watch nowPhysical Hardware, Digital Analytics: IoT Challenges, Best Practices, and Solutions
From supporting ad-hoc queries across massive time series datasets to ensuring data freshness and scalability, our panelists will share insights into selecting the right database solutions that can deliver...
Watch now