Skip to content

Introducing Ververica’s New Brand Identity!

Read more

Flink Forward San Francisco Preview: Real-time Anomaly Detection with Mux


by

Last month, software engineer Scott Kidder (@hexdumpster) of Mux published a popular post on his company's blog titled "Discovering Anomalies in Real-Time with Apache Flink". The post covered Mux's process for adding anomaly-detection alerting to its product, starting with evaluating different streaming frameworks through to which Apache Flink® operators are used in the application.

Mux's event pipeline from their blog post
 A diagram from the Mux post
 

Lucky for all of us, the blog post was just a preview of things to come, and Scott will be presenting on the topic at the first-ever Flink Forward in San Francisco on April 11. From his talk's abstract:

Mux uses Apache Flink to identify anomalies in the distribution & playback of digital video for major video streaming websites. Scott Kidder will describe the Apache Flink deployment at Mux leveraging Docker, AWS Kinesis, Zookeeper, HDFS, and InfluxDB. Deploying a Flink application in a zero-downtime production environment can be tricky, so unit- & behavioral-testing, application packaging, upgrade, and monitoring strategies will be covered as well.


His talk is timely, both because of Flink's increasing popularity in real-time alerting & anomaly detection applications and because of his discussion of deployment-related issues--an area where much is happening in the Flink community.


San Francisco-based Mux is a Y Combinator graduate whose product provides monitoring and analytics for streaming video. The company was founded by experts in the space from the likes of Brightcove and Zencoder, and Scott himself has been working with video for more than 10 years. By the way, they're hiring.


To see Scott's talk along with 25 others, buy your ticket to Flink Forward San Francisco today. P.S. For more recommended reading, Scott also published a nice piece about using Flink's Amazon Kinesis connector and building the connector source. Check it out.

Topics:
Article by:

Michael Winters

Comments

Our Latest Blogs

Announcing Ververica Platform 2.7 for Apache Flink® 1.15 featured image
by Daisy Tsang July 12, 2022

Announcing Ververica Platform 2.7 for Apache Flink® 1.15

The latest minor release includes full support for Flink 1.15, several improvements to the user experience, and a brand new look!
Read More
Introducing Ververica’s New Brand Identity featured image
by Alexander Walden June 21, 2022

Introducing Ververica’s New Brand Identity

Today we are extremely excited to introduce our new visual brand identity for Ververica and our products, such as Ververica Platform! This has been in the works for many months, and a project we...
Read More
Monitoring Large-Scale Apache Flink Applications, Part 2: Metrics for Troubleshooting featured image
by Nico Kruber May 31, 2022

Monitoring Large-Scale Apache Flink Applications, Part 2: Metrics for Troubleshooting

The previous article in this series focused on continuous application monitoring and presented the most useful metrics from our point of view. However, Flink’s metrics system offers a lot more, and...
Read More