Skip to content

Ververica Cloud, a fully-managed cloud service for stream processing!

Learn more

Queryable State or How to Build a Billing System Without a Database


by

Konstantin Knauf and Maximilian Bode of Munich-based TNG Technology Consulting are no strangers to stateful stream processing. They've been working closely with Apache Flink® for well over a year now, and in their Flink Forward 2016 talk in Berlin, they detailed their experience building an anonymization platform for one of Germany's largest mobile network providers, processing billions of records in near-real-time every day.

And in April 2017, TNG is partnering with data Artisans to provide Apache Flink training for more than 20 of their developers, further spreading Flink expertise within the company.

TNGAt Flink Forward San Francisco, Konstantin and Max will present "Queryable State or How to Build a Billing System Without a Database", getting into a sample use case for one of Flink 1.2.0's new features (which we covered at a high level in a blog post this week, too). qb-sketch Their talk's abstract provides more detail:

Traditionally, big data applications rely on the Lambda Architecture in
order to achieve low latency as well as completeness. A streaming layer provides real-time previews while a complementary batch layer retrospectively recomputes the correct results. Using a robust stream processor like Apache Flink, we can do without the latter. But can we take it even one step further? This talk will discuss one of the upcoming features of Apache Flink with the potential to do just that.

As a real-world example, we have built a prototype for a robust billing system based on Flink and Queryable State. On the one hand, the system exposes the current monthly subtotals in real-time to front-end applications, on the other hand it reports the complete results to downstream systems, e.g. for invoicing. As completeness and correctness are core requirements for a billing system, we will demonstrate the system in multiple failure scenarios, including taskmanager and jobmanager failures as well as unavailability of downstream systems. This talk will give you an idea of how “Queryable State” combined with a robust stream processor enables new streaming uses cases and changes the future of streaming application architecture.

Won't be able to make it to Flink Forward San Francisco? No worries. TNG is hosting a Flink meetup in Munich on Thursday, April 27 where they'll present the talk again.

TNG Technology Consulting, founded in 2001, is made up of more than 250 employees in Munich, Germany. The firm provides support in agile software development, administration & operations, and IT management. To see Konstantin and Max's talk along with 25 others, buy your ticket to Flink Forward San Francisco today.

New call-to-action

Topics:
Article by:

Michael Winters

Comments

Our Latest Blogs

Q&A with Erik de Nooij: Insights into Apache Flink and the Future of Streaming Data featured image
by Kaye Lincoln 09 April 2024

Q&A with Erik de Nooij: Insights into Apache Flink and the Future of Streaming Data

Ververica is proud to host the Flink Forward conferences, uniting Apache Flink® and streaming data communities. Each year we nominate a Program Chair to select a broad range of Program Committee...
Read More
Ververica donates Flink CDC - Empowering Real-Time Data Integration for the Community featured image
by Ververica 03 April 2024

Ververica donates Flink CDC - Empowering Real-Time Data Integration for the Community

Ververica has officially donated Flink Change Data Capture (CDC) to the Apache Software Foundation. In this blog, we’ll explore the significance of this milestone, and how it positions Flink CDC as a...
Read More
Announcing the Release of Apache Flink 1.19 featured image
by Lincoln Lee 18 March 2024

Announcing the Release of Apache Flink 1.19

The Apache Flink PMC is pleased to announce the release of Apache Flink 1.19.0. As usual, we are looking at a packed release with a wide variety of improvements and new features. Overall, 162 people...
Read More