Level Up Your Kafka Skills in Just 5 Days | Join Season of Streaming On-Demand
Scalability
From the Cellar to the Cloud – How Aedifion is Driving Next-Generation Building Automation with Confluent
It is no exaggeration that a lot is going wrong in commercial buildings today. The building and construction sector consumes 36% of global final energy and accounts for almost 40% […]
Design Considerations for Cloud-Native Data Systems
Twenty years ago, the data warehouses of choice were Oracle and Teradata. Since then, growth and innovation has shifted to the cloud, and a new generation of data systems have […]
Building the Confluent UI with React Hooks – Benefits and Lessons Learned
Updating a fundamental paradigm in your React app can be as easy as search and replace, or at other times, as difficult as convincing your entire frontend engineering to buy […]
Apache Kafka Made Simple: A First Glimpse of a Kafka Without ZooKeeper
At the heart of Apache Kafka® sits the log—a simple data structure that uses sequential operations that work symbiotically with the underlying hardware. Efficient disk buffering and CPU cache usage,...
Lessons Learned from Running Apache Kafka at Scale at Pinterest
Apache Kafka® is at the heart of the data transportation layer at Pinterest. The amount of data that runs through Kafka has constantly grown over the years. This growth sometimes […]
How Real-Time Stream Processing Safely Scales with ksqlDB, Animated
Software engineering memes are in vogue, and nothing is more fashionable than joking about how complicated distributed systems can be. Despite the ribbing, many people adopt them. Why? Distributed systems […]
Project Metamorphosis Month 2: Cost-Effective Apache Kafka for Use Cases Big and Small
In April, we kicked off Project Metamorphosis. Project Metamorphosis is an effort to bring the simplicity of best of breed cloud systems to the world of event streaming. It is […]
Scaling Apache Kafka to 10+ GB Per Second in Confluent Cloud
Apache Kafka® is the de facto standard for event streaming today. The semantics of the partitioned consumer model that Kafka pioneered have enabled scale at a level and at a […]
Stream Processing with IoT Data: Challenges, Best Practices, and Techniques
The rise of IoT devices means that we have to collect, process, and analyze orders of magnitude more data than ever before. As sensors and devices become ever more ubiquitous, […]
99th Percentile Latency at Scale with Apache Kafka
Fraud detection, payment systems, and stock trading platforms are only a few of many Apache Kafka® use cases that require both fast and predictable delivery of data. For example, detecting […]
Incremental Cooperative Rebalancing in Apache Kafka: Why Stop the World When You Can Change It?
There is a coming and a going / A parting and often no—meeting again. —Franz Kafka, 1897 Load balancing and scheduling are at the heart of every distributed system, and […]
Introducing a Cloud-Native Experience for Apache Kafka in Confluent Cloud
In the last year, we’ve experienced enormous growth on Confluent Cloud, our fully managed Apache Kafka® service. Confluent Cloud now handles several GB/s of traffic—a 200-fold increase in just six […]
Apache Kafka Data Access Semantics: Consumers and Membership
Every developer who uses Apache Kafka® has used a Kafka consumer at least once. Although it is the simplest way to subscribe to and access events from Kafka, behind the […]
Dawn of Kafka DevOps: Managing Kafka Clusters at Scale with Confluent Control Center
When managing Apache Kafka® clusters at scale, tasks that are simple on small clusters turn into significant burdens. To be fair, a lot of things turn into significant burdens at […]