Project Metamorphosis: Unveiling the next-gen event streaming platformLearn More

Confluent Cloud KSQL is Now Available

Today, we are excited to announce that after a highly productive period of being in private preview, Confluent Cloud KSQL is now production ready and available to all Confluent Cloud customers on usage-based billing plans. Before presenting an overview of Confluent Cloud KSQL’s features, we would like to briefly provide some background around what led us here, and why we believe KSQL is such an important technology.

Apache Kafka® is increasingly becoming the single source of truth for many organizations’ data. And as these organizations continue to prefer cloud-hosted infrastructure in order to reduce their operational burdens, Confluent Cloud provides one of the easiest ways to obtain a robust, production-ready Kafka environment in just a few minutes. As the central nervous system for your data, a fully managed Kafka environment eliminates the complexities around operating critical infrastructure. But the true value of data is derived from whatever an organization actually does with it.

Producers push events into Kafka, and consumers pull them out for downstream processing. Often this processing is done using complex application code performing very common operations: transformations, enrichment, joining events together, and aggregation are all fundamental to most data processing pipelines. Real-time processing brings an organization’s data to life by invigorating it with a certain level of autonomous intelligence. If Kafka is the central nervous system, then the stream processing layer is the brain, taking streams of events as input, applying predefined logic, and producing new streams as output.

And just as traditional databases have abstracted away common operations performed on data at rest, stream processing tools offer the same abstractions for event streaming. KSQL enables users to define this processing using largely standard SQL syntax, making it immediately accessible to most organizations. No complex application code is required—KSQL will take SQL queries and figure out how to continuously execute them efficiently atop torrents of streaming events.

KSQL’s accessibility is further amplified in Confluent Cloud, where KSQL is available as a fully managed service. In addition to providing the immense benefits of SQL queries over code, Confluent Cloud KSQL eliminates the innate complexities of operating infrastructure in production. We take care of running production-grade infrastructure at scale while you focus on solving business problems with KSQL. Transformations, stream-to-stream joins, aggregations, and data enrichment can all be accomplished using KSQL with just a few lines of SQL.

In addition to providing the core capabilities of KSQL, Confluent Cloud KSQL also layers on valuable functionality based on everything we’ve learned about how organizations are doing stream processing. In particular, Confluent Cloud KSQL’s intuitive web interface is designed to simplify your interactions with KSQL: create streams and tables with a few clicks, or submit continuous SQL queries through the query editor while browsing the schemas of the various streams and tables your queries target.

Confluent Cloud KSQL Web Interface

As you create and chain together more of these continuous queries, stream processing workloads can become complex. To help manage this complexity, Confluent Cloud KSQL includes a “Flow” view that visualizes your end-to-end workload as a topology of continuous queries. Individual queries in the processing topology can be inspected to examine messages flowing through them or to identify throughput bottlenecks in your workload. The status of each continuous query can be quickly evaluated in a single place in order to help you ensure that your topology is healthy.

Confluent Cloud KSQL "Flow" View

Your applications can also programmatically integrate with Confluent Cloud KSQL by securely connecting to your KSQL application’s REST endpoint, bypassing the web interface entirely. In fact, you have unrestricted access to the same APIs that the web interface uses, enabling you to develop deep integrations that deliver real-time intelligence to your applications and services.

Confluent Cloud KSQL also integrates seamlessly with the other components of Confluent Cloud, which are designed to work together synergistically. Your KSQL applications will be connected to Kafka and Schema Registry out of the box, and deeper integration with Kafka Connect is planned for a future release. Regardless of how you choose to use Confluent Cloud KSQL, no operational overhead is required on your part. We’ll ensure that your application runs with the highest degree of reliability in production while you focus on solving business problems.

Get started with Confluent Cloud KSQL

To start using Confluent Cloud KSQL, you can sign up for Confluent Cloud, a fully managed event streaming service based on Apache Kafka, and get $50 of free usage each month for the first three months. Once you sign in to Confluent Cloud, these links will help you get started with KSQL quickly:

Derek Nelson is a senior product manager at Confluent. He was previously the founder of PipelineDB, a database technology startup that built a SQL engine for stream processing.

Did you like this blog post? Share it now

Subscribe to the Confluent blog

More Articles Like This

Announcing ksqlDB 0.10.0

We’re excited to announce the release of ksqlDB 0.10.0, available now in the standalone distribution and on Confluent Cloud! This version includes a first-class Java client, improved Apache Kafka® key […]

Unifying Streams and State: The Seamless Path to Real-Time

More than ever before, people demand immediacy in every aspect of their lives. Expectations for how we shop, bank, and commute have completely evolved over the last decade. When you […]

Real-Time Fleet Management Using Confluent Cloud and MongoDB

Most organisations maintain fleets, a collection of vehicles put to use for day-to-day operations. Telcos use a variety of vehicles including cars, vans, and trucks for service, delivery, and maintenance. […]

Sign Up Now

Start your 3-month trial. Get up to $200 off on each of your first 3 Confluent Cloud monthly bills

Nouvelles inscriptions uniquement.

En cliquant sur le bouton « inscription » ci-dessus, vous acceptez que nous traitions vos informations personnelles conformément à notre Politique de confidentialité.

En cliquant sur « Inscription » ci-dessus, vous acceptez les termes du/de la Conditions d'utilisation et de recevoir occasionnellement des e-mails publicitaires de la part de Confluent. Vous comprenez également que nous traiterons vos informations personnelles conformément à notre Politique de confidentialité.

Gratuit à vie sur un seul broker Kafka

Le logiciel permettra une utilisation illimitée dans le temps de fonctionnalités commerciales sur un seul broker Kafka. Après l'ajout d'un second broker, un compteur de 30 jours démarrera automatiquement sur les fonctionnalités commerciales. Celui-ci ne pourra pas être réinitialisé en revenant à un seul broker.

Sélectionnez un type de déploiement
Déploiement manuel
  • tar
  • zip
  • deb
  • rpm
  • docker
Déploiement automatique
  • kubernetes
  • ansible

En cliquant sur le bouton « télécharger gratuitement » ci-dessus, vous acceptez que nous traitions vos informations personnelles conformément à notre Politique de confidentialité.

En cliquant sur « Téléchargement gratuit » ci-dessus, vous acceptez la Contrat de licence Confluent et de recevoir occasionnellement des e-mails publicitaires de la part de Confluent. Vous acceptez également que vos renseignements personnels soient traitées conformément à notre Politique de confidentialité.

Ce site Web utilise des cookies afin d'améliorer l'expérience utilisateur et analyser les performances et le trafic sur notre site Web. Nous partageons également des informations concernant votre utilisation de notre site avec nos partenaires publicitaires, analytiques et de réseaux sociaux.