Déploiement d'Apache Kafka

Compatibility Testing For Apache Kafka

Jay Kreps
Last Updated: 

Testing is one of the hardest parts of building reliable distributed systems. Kafka has long had a set of system tests that cover distributed operation but this is an area that is simply never good enough.

At Confluent and Cloudera we’ve both been working on improving the testing capabilities for Kafka.

An area of particular importance is compatibility. Companies that want to build reliable data real-time data flow and processing around Kafka need to be able to do so without fear of incompatibilities that could arise release to release or between versions of Kafka from different vendors.

We’re announcing today a project with the folks at Cloudera and the rest of the open source community to develop high quality tests to certify API and protocol compatibility between versions and distributions.

We’ll be doing this as part of the normal Apache development process, much as we do any other Kafka development.

We think ensuring this kind of compatibility is one of the key aspects of building a healthy ecosystem of systems, applications, and processing frameworks, that is the core of our stream data platform goal.

Subscribe to the Confluent Blog

S'abonner

More Articles Like This

Apache Kafka Producer Improvements with the Sticky Partitioner
Justine Olshan

Apache Kafka Producer Improvements with the Sticky Partitioner

Justine Olshan

The amount of time it takes for a message to move through a system plays a big role in the performance of distributed systems like Apache Kafka®. In Kafka, the […]

Testing Kafka Streams Using TestInputTopic and TestOutputTopic
Jukka Karvanen

Testing Kafka Streams Using TestInputTopic and TestOutputTopic

Jukka Karvanen

As a test class that allows you to test Kafka Streams logic, TopologyTestDriver is a lot faster than utilizing EmbeddedSingleNodeKafkaCluster and makes it possible to simulate different timing scenarios. Not […]

Integrating Apache Kafka With Python Asyncio Web Applications
Matt Howlett

Integrating Apache Kafka With Python Asyncio Web Applications

Matt Howlett

Modern Python has very good support for cooperative multitasking. Coroutines were first added to the language in version 2.5 with PEP 342 and their use is becoming mainstream following the […]

Fully managed Apache Kafka as a Service!

Try Free