Recommendations for Deploying Apache Kafka on Kubernetes

There is a growing need for automation that enables organizations to scale efficiently and effectively. Using Kubernetes for all services deployed in production not only increases manageability by automating their operations but also improves availability, as well as provides more flexibility around resource management.

In this white paper, Principal Data Architect, Gwen Shapira will:

• Describe Kubernetes terms, concepts and considerations
• Explain helm charts, storage, traffic, log aggregation, metrics and more
• Share best practices to help software developers and production operations teams with their deployment of Confluent Platform—a more complete distribution of Apache Kafka—on Kubernetes

Author

Gwen Shapira, Principal Data Architect, Confluent

Gwen is a principal data architect at Confluent. She has 15 years of experience working with code and customers to build scalable data architectures, integrating relational and big data technologies. She currently specializes in building real-time reliable data processing pipelines using Apache Kafka. Gwen is an Oracle Ace Director, an author of books including Kafka: The Definitive Guide and a frequent presenter at data related conferences. Gwen is also a committer on the Apache Kafka and Apache Sqoop projects.