국내 No.1 에너지 IT기업 ‘해줌’의 컨플루언트 클라우드 도입 스토리 | 알아보고 등록하기

로그인 문의하기

데모 보기무료로 시작하기

Apache Kafka 0.8.2.1 release

작성자:
  • Jun RaoCo-founder of Confluent and original co-creator of Apache Kafka®

The Apache Kafka community just announced the 0.8.2.1 release. This is a a bug fix release and fixes 4 critical issues reported in the 0.8.2.0 release (the full list of features can be found here).

  • The first issue is that in certain cases, a broker can use significantly more CPU compared with the 0.8.1 release. This happens when (1) replication is used, (2) the number of partitions per broker is high (say a few thousand) and (3) the cluster is small (say less than 5 brokers).
  • The second issue is that when starting a broker with a conflicting broker id, the process of shutting down this broker accidentally removes critical broker registration in ZooKeeper. This may cause some of the topic partitions to be unavailable unexpectedly later on.
  • The last two issues are in the new Java producer. We fixed an issue that a message may not be delivered since the producer doesn’t correctly pick an available partition. This tends to happen when the replication factor is only one and one or more brokers fail. Another issue that we fixed is that on an empty Kafka cluster, the CPU usage of the new producer is high after initialization.

Since those issues are relatively critical, we recommend everyone upgrade to the 0.8.2.1 release. Note that all those changes are already included in the Kafka jar shipped with Confluent Platform 1.0.

  • Jun Rao is the co-founder of Confluent, a company that provides a stream data platform on top of Apache Kafka. Before Confluent, Jun Rao was a senior staff engineer at LinkedIn where he led the development of Kafka. Before LinkedIn, Jun Rao was a researcher at IBM's Almaden research data center, where he conducted research on database and distributed systems. Jun Rao is the PMC chair of Apache Kafka and a committer of Apache Cassandra.

이 블로그 게시물이 마음에 드셨나요? 지금 공유해 주세요.

Introducing Apache Kafka® 3.9

Introducing Apache Kafka® 3.9

We are proud to announce the release of Apache Kafka 3.9.0. This is a major release, the final one in the 3.x line. This will also be the final major release to feature the deprecated Apache ZooKeeper® mode. Starting in 4.0 and later, Kafka will always run without ZooKeeper.

Preparing the Consumer Fetch: Kafka Producer and Consumer Internals, Part 3

Preparing the Consumer Fetch: Kafka Producer and Consumer Internals, Part 3

In this third installment of a blog series examining Kafka Producer and Consumer Internals, we switch our attention to Kafka consumer clients, examining how consumers interact with brokers, coordinate their partitions, and send requests to read data from Kafka topics.