Level Up Your Kafka Skills in Just 5 Days | Join Season of Streaming

Video

Unlocking Real-time Insights: BigCommerce’s Migration Strategy from Kafka to Confluent

Register Now

Learn how BigCommerce migrated 1.6 Billion events a day from Kafka to Confluent, saving 20+ hours a week in Kafka management in just five months.

BigCommerce had an ETL batch-based system that meant their merchants had to wait 8 hours before pulling any analytics and insights reporting (e.g., who is coming to their site, adding to their carts, popular products). The system consisted of 30 odd map-reduce jobs, which would sometimes fail and need manual intervention.

So what did they do?

This online talk showcases how BigCommerce transitioned their legacy ETL batch-based systems to an event-driven architecture in a four-phased approach.

Register now to learn how BigCommerce used Confluent to:

  • Build a data streaming platform alongside Google Cloud Platform to deliver real-time features like product recommendations
  • Provided real-time analytics and insights to their merchants via an open architecture
  • Elastically scaled their Kafka deployment to support spikes from Black Friday traffic
  • Increased system performance and reduced maintenance, such as software patches, blind spots in data infrastructure, and system updates

Sophia Jiang is a Group Product Marketing Manager at Confluent, where she is responsible for leading go-to-market for key marketing campaigns and product-led growth strategies. Prior to Confluent, Sophia led GTM for retail, CPG, and manufacturing verticals at MuleSoft. Sophia has a BA in Economics and International Studies from Emory University.

Mahendra Kumar is the VP of Data and Software Engineering at BigCommerce where he is responsible for Data Analytics, Search, ML strategy, and execution. Mahendra has built real-time distributed data platforms of massive scale in multiple organizations. He is passionate about building great teams and great products!

Additional Resources

cc demo

Confluent Cloud Demo

Join us for a live demo of Confluent Cloud, the industry’s only fully managed, cloud-native event streaming platform powered by Apache Kafka
kafka microservices

Kafka Microservices

In this online talk series, learn key concepts, use cases and best practices to harness the power of real-time streams for microservices architectures
Image-Event-Driven Microservices-01

e-book: Microservices Customer Stories

See how five organizations across a wide range of industries leveraged Confluent to build a new class of event-driven microservices