[Webinar] How to Protect Sensitive Data with CSFLE | Register Today
Stream Processing
Data Products, Data Contracts, and Change Data Capture
Change data capture is a popular method to connect database tables to data streams, but it comes with drawbacks. The next evolution of the CDC pattern, first-class data products, provide resilient pipelines that support both real-time and batch processing while isolating upstream systems...
Introducing Confluent Cloud Freight Clusters
Learn how the latest innovations in Kora enable us to introduce new Confluent Cloud Freight clusters, which can save you up to 90% at GBps+ scale. Confluent Cloud Freight clusters are now available in Early Access.
Contributing to Apache Kafka®: How to Write a KIP
Learn how to contribute to open source Apache Kafka by writing Kafka Improvement Proposals (KIPs) that solve problems and add features! Read on for real examples.
Readings in Streaming Database Systems
What will the next important category of databases look like? For decades, relational databases were the undisputed home of data. They powered everything: from websites to analytics, from customer data […]
A Guide to Kafka Streams and Its Uses
Kafka Streams is an abstraction over Apache Kafka® producers and consumers that lets you forget about low-level details and focus on processing your Kafka data. You could of course write […]
Announcing ksqlDB 0.21.0
We’re pleased to announce ksqlDB 0.21.0! This release includes a major upgrade to ksqlDB’s foreign-key joins, the new data type BYTES, and a new ARRAY_CONCAT function. All of these features […]
How ksqlDB Works: Internal Architecture and Advanced Features
To effectively use ksqlDB, the streaming database for Apache Kafka®, you should of course be familiar with its features and syntax. However, a deeper understanding of what goes on underneath […]
Announcing ksqlDB 0.20.0
We’re pleased to announce ksqlDB 0.20.0! The 0.20 ksqlDB release includes support for the DATE and TIME data types, along with functionality for working with these types. The DATE type […]
Announcing ksqlDB 0.19.0
We’re pleased to announce ksqlDB 0.19.0! This release includes a new NULLIF function and a major upgrade to ksqlDB’s data modeling capabilities—foreign-key joins. We’re excited to share this highly requested […]
Crossing the Streams: The New Streaming Foreign-Key Join Feature in Kafka Streams
Companies adopt streaming data and Apache Kafka® because it provides them with real-time information about their business and customers. In practice, the challenge is that this information is spread across […]
Online, Managed Schema Evolution with ksqlDB Migrations
Making changes to a database schema is a natural part of software development. Often, it’s important to carefully manage the timing of changes and keep track of them over time. […]
Consistency and Completeness: Rethinking Distributed Stream Processing in Apache Kafka
Stream processing has become an important part of the big data landscape, a new programming paradigm bringing asynchronous, long-lived computations to unbounded data in motion. But many people still think […]
Are We There Yet? The Query Your Database Can’t Answer
What if I told you there is a query your database can’t answer? That would probably surprise you. With decades of effort behind them, databases are one of the most […]
Announcing ksqlDB 0.18.0
We’re pleased to announce ksqlDB 0.18.0! This release includes pull queries on table-table joins and support for variable substitution in the Java client and ksqlDB’s migration tool. We’ll step through […]
Streaming ETL with Confluent: Routing and Fan-Out of Apache Kafka Messages with ksqlDB
In the world of data engineering, data routing decisions are crucial to successful distributed system design. Some organizations choose to route data from within application code. Other teams hand off […]
Announcing ksqlDB 0.17.0
We’re excited to announce ksqlDB 0.17, a big release for 2021. This version adds support for managing the lifecycle of your queries from CI servers, a first-class timestamp data type, […]
Learning with LiveStreams: Cloud-Native Apache Kafka and Serverless Stream Processing
LiveStreams is a YouTube show about Confluent, real-time data streaming, and related technologies that help you maximize data in motion on any cloud. Every episode of LiveStreams will teach you […]