Flink 2.0: Navigating the Future of Unified Stream and Batch Processing

The Apache Flink community is working on a significant milestone with the planned release of Flink 2.0, marking a major evolution since the inception of Flink 1.0 in 2016. In this insightful talk, we will delve into the key enhancements and transformations slated for the 2.0 version, offering a comprehensive overview for users and developers eager to embrace the next frontier of stream and batch processing.

The talk will commence by exploring some of the core philosophies of Flink, emphasizing the unification of batch and streaming processing. We'll dissect the roadmap's commitment to a seamless blending of batch and streaming applications. Flink 2.0 isn't just about features; it's also a reimagining of Flink's architecture. We'll delve into the disaggregated state management approach, leveraging distributed file systems. This evolution is geared towards better load balancing and improved efficiency in cloud-native architectures. APIs play a pivotal role in Flink's evolution, and Flink 2.0 is no exception. The talk will outline plans to retire deprecated APIs, overhaul the configuration layer, new abstractions and of course other plans that live in the community.

Join us on this exploration of Flink 2.0, where we'll unravel the future of stream and batch processing and showcase how these advancements will shape the landscape of real-time data analytics.