Every Message Counts: Kafka as a Foundation for Highly Reliable Logging at Airbnb

Kafka plays a central role in the data ecosystem at Airbnb. We operate multiple clusters powering use cases such as analytics, change data capture and inter-service communication. In this talk we present on the design and usage of our streaming data pipeline for product analytics, including the services, tools and workflows we developed allowing us to meet strict quality and latency guarantees.