How Apache Flink manages Kafka consumer offsets
Step by step: how the Flink Kafka source stores partition offsets in checkpoints, how barriers keep operator state consistent, and how offsets are restored after a failure.
Fabian Hueske4 min read
Fabian Hueske
Developers Center articles by Fabian Hueske
State TTL for Apache Flink: How to Limit the Lifetime of State
How to configure state time-to-live (TTL) in Apache Flink: when the TTL is reset, whether expired state is returned, and how expired state is cleaned up.
Andrey Zagrebin7 min read
A Practical Guide to Broadcast State in Apache Flink
A practical guide to broadcast state in Apache Flink: broadcasting a pattern stream to all tasks and evaluating it on keyed user actions with KeyedBroadcastProcessFunction.
Fabian Hueske10 min read