Confluent Blog
Data Products, Data Contracts, and Change Data Capture
Change data capture is a popular method to connect database tables to data streams, but it comes with drawbacks. The next evolution of the CDC pattern, first-class data products, provide resilient pipelines that support both real-time and batch processing while isolating upstream systems...
Introducing Confluent Cloud Freight Clusters
Learn how the latest innovations in Kora enable us to introduce new Confluent Cloud Freight clusters, which can save you up to 90% at GBps+ scale. Confluent Cloud Freight clusters are now available in Early Access.
Contributing to Apache Kafka®: How to Write a KIP
Learn how to contribute to open source Apache Kafka by writing Kafka Improvement Proposals (KIPs) that solve problems and add features! Read on for real examples.
Watermarks, Tables, Event Time, and the Dataflow Model
The Google Dataflow team has done a fantastic job in evangelizing their model of handling time for stream processing. Their key observation is that in most cases you can’t globally […]
Kafka Summit NYC Systems Track: What to Expect
In our previous post on the Streaming Pipelines track, we highlighted some of the sessions not to be missed at Kafka Summit NYC. As a follow on to that, let’s […]
Stories from the Front: Lessons Learned from Supporting Apache Kafka®
Here at Confluent, our goal is to ensure every company is successful with their streaming platform deployments. Oftentimes, we’re asked to come in and provide guidance and tips as developers […]
Creating a Data Pipeline with the Kafka Connect API – from Architecture to Operations
Pandora began adoption of Apache Kafka® in 2016 to orient its infrastructure around real-time stream processing analytics. As a data-driven company, we have a several thousand node Hadoop clusters with hundreds of Hive tables critical to Pandora’s operational and reporting success...
Kafka Summit NYC: Streaming Pipelines Track – What to Expect
It is just a few weeks out until Kafka Summit NYC! Since we’re on the program committee for this event and are also the track leads for the Streaming Pipelines track, […]
Securing the Confluent Schema Registry for Apache Kafka®
Note: The blog post Ensure Data Quality and Data Evolvability with a Secured Schema Registry contains more recent information. If you use Apache Kafka to integrate and decouple different data […]
There’s So Much More to Apache Kafka than Just Hadoop
It’s Strata+Hadoop World this week, and the who’s who of the data management world will gather at the San Jose Convention Center to talk all things big data. I’m kind […]
Log Compaction – Highlights in the Apache Kafka® and Stream Processing Community – March 2017
Big news this month! First and foremost, Confluent Platform 3.2.0 with Apache Kafka® 0.10.2.0 was released! Read about the new features, check out all 200 bug fixes and performance improvements […]
The Arrival of Streaming: Confluent Raises $50 Million Series C
I have some exciting news to share: we’ve completed a $50 million investment led by our newest partner, Sequoia Capital and Matt Miller of Sequoia will be joining our board […]
Confluent 3.2 with Apache Kafka® 0.10.2 Now Available
We’re excited to announce the release of Confluent 3.2, our enterprise streaming platform built on Apache Kafka. At Confluent, our vision is to provide a comprehensive, enterprise-ready streaming platform that […]
Kinetica Joins Confluent Partner Program and Releases Confluent Certified Connector for Apache Kafka®
This guest post is written by Chris Prendergast, VP of Business Development and Alliances at Kinetica. Today, we’re excited to announce that we have joined the Confluent Partner Program and […]
Join us for Kafka Summit Hackathon in New York City
I’m happy to announce Confluent will be hosting another Kafka Summit Hackathon on May 7th in New York City! The free hackathon will take place a day prior to Kafka […]
Kafka Summit New York Keynote Speakers and Agenda Set
We are excited to announce the keynote speakers and agenda for Kafka Summit NYC on May 8th! Mirroring the growth of Apache Kafka®, we received an overwhelming number of speaking […]
The First Annual State of Apache Kafka® Client Use Survey
At the end of 2016 we conducted a survey of the Apache Kafka® community regarding their use of Kafka clients (the producers and consumers used with Kafka) and their priorities […]