Orb

How Apache Druid and Imply Helped Orb Scale Their Usage-Based Billing Platform

“Druid powers our core responsibility, which is keeping invoices up to date. So with all these events in Druid, we're executing the queries that customers have defined, which power their line items and the quantities on those line items. We're constantly keeping our customers' customers’ invoices up to date with the data that's in Druid.”
Kshitij Grover, CTO and Co-Founder  |    Orb

Summary

Orb, a modern billing engine purpose-built for companies with complex pricing models, overcame database challenges and achieved significant success with Apache Druid and Imply. Facing scalability issues with PostgreSQL and the complexity of integrating alternatives like Snowflake, Orb shifted to Apache Druid for its scalability, real-time analytics, and SQL compatibility. By leveraging Imply's resources, Orb was able to enhance visibility into cluster performance and optimize query efficiency, saving valuable time and resources for its engineering team. With Apache Druid and Imply, Orb streamlined billing operations, extended its services to encompass financial reporting and revenue recognition, and positioned itself for continued growth and success in the competitive market landscape.

Overview

Orb is on a mission to provide every business with the infrastructure to unlock their revenue. Designed specifically for organizations with complex pricing plans and business models, Orb's modern pricing platform enables companies to bill for seats, consumption, and everything in between.

By using Orb, companies can introduce transparency into the billing process, fine tune their price strategies, include real-time data in invoices, and remove errors in revenue reporting. Customers span a range of industries, such as infrastructure, developer tooling, fintech, SaaS, and AI.

Challenge

Orb initially chose PostgreSQL for its database needs. However, as its customer base and data volumes expanded, Orb encountered scalability issues with PostgreSQL, particularly concerning ingestion and query performance. Additionally, Orb required a database solution specialized in time-series data and optimized for aggregations, which PostgreSQL couldn't fully provide. They needed a database solution that offered scalability, real-time analytics, and compatibility with SQL without excessive engineering complexity.

Solution

After exploring various options including Snowflake, Clickhouse, and Apache Pinot, Orb ultimately chose Apache Druid as its database. Druid's native support for Apache Kafka ensured exactly-once ingestion for streaming data, streamlining the integration process and reducing engineering overhead.

Additionally, Druid's scalability and mature managed services provided by Imply made it the right choice for Orb's needs. Druid’s built-in compatibility with SQL simplified debugging and issue resolution for Orb's engineers, facilitating seamless integration into their workflow. By choosing to use Imply for their Druid implementation, Orb gained access to tools like Imply Clarity for monitoring and analyzing Druid operations, enhancing visibility into cluster performance and workload efficiency.

Results

By implementing Apache Druid with Imply, Orb successfully addressed its scalability and performance challenges while minimizing engineering complexity. The streamlined integration with Kafka and the scalability of Druid's infrastructure allowed Orb to enhance its billing services while maintaining focus on its core competencies.

"One of the things people want to know about billing vendors is that—as usage grows, are they going to be able to rely on us for critical infrastructure? Because we can scale Druid up pretty easily, we can say, ‘Hey if you’re a big company and you want to do this large stress test, we can provision an appropriate cluster for you as your usage grows.’ That talk track has been really positive, and people can understand that."- Kshitij Grover, CTO and co-founder, Orb

With enhanced observability and support from Imply, Orb optimized query performance and workload efficiency, saving valuable time and resources for its engineering team.

"Working with Imply support has saved us 20-30 hours a month of scaling our workload, which is pretty significant."

The versatility of Druid with Imply enabled Orb to extend its use beyond invoicing to encompass financial reporting, accounting, and revenue recognition—ultimately evolving to meet their customer needs.

Orb's strategic adoption of Druid with Imply not only fulfilled several core requirements, but also positioned it for continued growth and success in the competitive landscape, reinforcing confidence in its technology choice and alignment with its long-term objectives.

References

Highlights

  • Able to scale and handle event volume that doubles or triples every few months
  • Able to support customers with hundreds of thousands to millions of events per second
  • Saved up to 30 hours a month on scaling their workload

See more similar to Orb

Atlassian Switches from PostgreSQL to Druid for Customer Analytics

Atlassian is a software company with a suite of products designed to enable collaboration among software developers, project managers, and other software development teams. Atlassian chose Druid to power their...

Learn More
Yahoo

Yahoo uses Druid and DataSketches for Real-time Behavioral Analytics

As its audience and advertising data volumes grew, Yahoo faced increasing demand to make data more accessible, both to internal users and customers. To address the demand for data, the Yahoo team decided to...

Learn More
Paytm

Paytm Built a PB-scale Analytics Application using Druid with Imply

Paytm, India’s leading financial services company, switched to Imply to support a powerful, cost-efficient application that enables hundreds of internal users to analyze customer behavioral data in real-time.

Learn More
Ibotta

Security at Speed: Why Ibotta Built Real-Time Fraud Detection on Imply

Ibotta, a free cashback rewards platform, chose Druid to power their multifaceted fraud prevention strategy that combines data from third-party vendors with Ibotta’s own data to make decisions about fraud...

Learn More
Cisco Thousand Eyes

Cisco ThousandEyes and Druid: Visualizing and Mapping Network Data

Cisco ThousandEyes enables organizations to visualize networks, surface insights, and collaborate with service providers to solve problems. To quickly analyze network device issues, ThousandEyes built an analytics...

Learn More
Blis

Blis+Imply: Real-Time Analytics for Adtech—At Massive Scale

Blis is an integrated advertising planning and buying platform that delivers scaled, relevant, and high-performing audiences to the world’s top brands and media agencies. Blis chose Imply to implement real-time...

Learn More
Pinterest

Pinterest and Druid: Optimizing Advertising for 400 Million+ Visitors

Pinterest chose Druid to power Archmage, their real-time analytics application that enables advertisers to effectively reach over 400 million people who use Pinterest every month.

Learn More
Rakuten

Rakuten relies on Druid to Analyze Millions of Records per Second

Rakuten is an affiliate marketing company that helps users earn cash back by shopping through their site. As one of the biggest data-driven companies in Japan, Rakuten ingests and processes huge amounts of...

Learn More
PayPal

PayPal chooses Druid to Optimize the User Journey with User Analytics

PayPal is an online payment system that enables individuals and businesses to send and receive money securely through its mobile app or website. PayPal uses Druid to analyze behavioral data generated from users...

Learn More
Ippen Digital

Ippen Digital + Imply: A Foundation for Mission-Critical Analytics

Ippen Digital offers an integrated platform to aggregate content, drive subscription growth and manage advertising across a broad range of digital content. Ippen Digital chose Apache Druid and Imply to achieve...

Learn More
Reddit

Reddit Analyzes Advertisement Data in Real Time Using Druid with Imply

Reddit generates tens of gigabytes of event data per hour from advertisements on its platform. To let advertisers both understand their impact and decide how to target their spending, Reddit needed to enable...

Learn More
Iron Source

ironSource + Imply: Codeless Queries and Interactive Dashboards

As the leading business platform for the app economy, IronSource provides an array of services to monetize and scale applications, all using streams powered by Confluent and real-time dashboards powered by...

Learn More
Zillow Group

Zillow and Imply: Empowering Internal Users with Self-Serve Analytics

As the most-visited real estate website in the United States, Zillow and its affiliates offer customers an on-demand experience for selling, buying, renting and financing with transparency and nearly seamless...

Learn More
Poshmark

How Poshmark Uses Druid to Monitor Their Platform in Real Time

Poshmark is a leading social marketplace for buying and selling of second hand fashion and home goods. Poshmark's team chose Apache Druid to as the core of their analytics framework that lets users explore...

Learn More
Adikteev

Adikteev Achieves Subsecond Latency for Customer Analytics with Imply

Adikteev designs and executes mobile marketing campaigns for their clients in order to boost app use and engagement. With Imply, built from Apache Druid, Adikteev created customer-facing dashboards that enable...

Learn More
Citrix

Citrix uses Druid to Prevent Security Threats in Real-time

Citrix is a digital workspace platform that gives employees everything they need to be productive in one unified experience while arming IT with the visibility, simplicity, and security needed to enable and...

Learn More
Confluent

Scale, Streaming, and Subsecond Queries: Confluent and Apache Druid

Confluent is a full-scale data streaming platform that enables its customers to easily access, store, and manage data as continuous, real-time streams. Confluent turned to Druid because their existing NoSQL...

Learn More
Splunk

Imply and Druid: The Foundation of Splunk’s Real-Time Analytics Engine

Splunk is the world’s first Data-to-Everything™ Platform, designed to remove the barriers between data and action to turn data into doing for its 19,000+ customers. With Apache Druid and Imply powering...

Learn More
Walmart

Walmart uses Apache Druid to Track Competitor Pricing in Real Time

Walmart chose Druid as part of their technology stack to track the pricing of their competitors in real-time. With Druid, latencies dropped to near subsecond levels while easily scaling to more than 1 billion...

Learn More
GameAnalytics

GameAnalytics turns 57M Game Events per Day into Real-time Insights

GameAnalytics is the number one analytics tool for anyone building a mobile game, from indie developers and game studios to established publishers. The platform receives, stores, and processes game events from...

Learn More
Amobee

Amobee Scales Ad Analytics, Querying Trillions of Rows in Milliseconds

Amobee provides end-to-end advertising campaigns and portfolio management across TV, digital and social media for some of the world’s largest brands. Since implementing Apache Druid, Amobee has been able...

Learn More
Target

Target and Apache Druid: Real-Time Analytics at Massive Scale

As a data-driven organization, US-based retailer Target needed a data analytics platform that could address the unique needs of each of its various business units, while scaling to hundreds of thousands of...

Learn More
Twitch

Data for All: How Twitch Used Imply to Build Self-Service Analytics

As Twitch grew, the amount of data they received and the number of employees interested in using data grew rapidly. To continue empowering decision-making as they scaled, Twitch turned to Druid and Imply to...

Learn More
Salesforce

Salesforce Chooses Apache Druid For Their Edge Observability Platform

To ensure a consistently great experience for more than 150,000 customers around the globe, Salesforce built an observability application powered by Druid. Now, Salesforce is able to obtain data-driven insights...

Learn More
Nielsen Marketing Cloud

How Nielsen Marketing Cloud Uses Druid to Analyze Audience Trends

Nielsen Marketing Cloud provides a way to profile the various audiences that marketers and publishers would like to target on digital media, activate via various ad networks, and then gain insights on ad performance....

Learn More
Expedia Logo

Personalizing Travel: Expedia, Imply, and the Art of Segmentation

As one of the world’s top travel platforms, Expedia Group manages customer experiences across more than 200 booking sites and 25 brands including Brand Expedia, Orbitz, Travelocity, Vrbo, and Hotels.com....

Learn More
TrueCar

Speed, Security, and Scaling: Why TrueCar Uses Imply + Druid

TrueCar is the most efficient and transparent way to find a car. TrueCar chose Druid and Imply to make their dashboards real-time, detect anomalies, and do so while minimizing engineering and operational overhead.

Learn More
Netflix

How Druid Provides Internet-Scale Observability at Netflix

Netflix built an observability analytics app powered by Druid, enabling them to monitor playback quality and ensure a consistently great user experience across all devices and operating systems.

Learn More
NTT

How NTT Powers Their Analytics Stack and Data Exploration with Imply

NTT is one of the largest telecommunications companies in the world. NTT Global IP Network (GIN) business unit chose Druid and Imply to power their analytics stack, unlocking new data exploration use cases...

Learn More
WalkMe

WalkMe Delivers Real-time Analytics for Digital Adoption Platform

WalkMe is a Digital Adoption Platform (DAP) pioneer that offers a 360-degree solution to leading organizations worldwide. WalkMe chose Druid to power their internal and external analytics applications, enabling...

Learn More
Sift

Sift: Achieving Real-Time Anomaly Detection with Imply + Druid

Sift is the leader in Digital Trust & Safety, empowering companies of all sizes to unlock revenue without risk. Sift chose Druid to power their automated monitoring tool, Watchtower, a system that would use...

Learn More
Charter

How Charter Communications Improves Customer Experiences with Imply

Charter Communications is a leading broadband connectivity company and cable operator serving more than 30 million customers in 41 states through its Spectrum brand. Charter chose Druid and Imply as the foundation...

Learn More

With Imply for Druid,
save time and money.

Imply is the easiest way to build with Druid through our cloud service and committer-driven expertise. For existing Apache Druid users, we can guarantee it.

Get started

Let us help with your analytics apps

Request a Demo