Reliable, Scalable, Automated Kafka Streams
Explore our guides and examples
Stop fighting with restoration, rebalancing, and resource management. Responsive's Java SDK, Control plane, and storage solutions collectively separate storage from compute and automate operations while maintaining 100% compatibility with your existing code and deployment architecture.
Separate compute from storage
Read about the Responsive SDK
Policy-based, metrics-driven autoscaling
Read about the Responsive Control Plane
Scale throughput beyond partition limits
Read about the Async Processing
Cloud-native, bespoke streaming storage
Read about the RS3 storage engine
Architecture Overview
The Responsive solution comprises the Java SDK, Control plane, and storage providers which combine as follows:
| Component | Description |
|---|---|
| Kafka Provider | Your Kafka provider: it could be self-hosted, cloud (e.g., Confluent, Redpanda, Warpstream), or locally for testing. |
| Java SDK | A Kafka Streams library extension with features like remote storage, async processing, and row-level TTL. Fully compatible with the Kafka Streams API; no app code changes required. |
| Responsive Operator | Manages Kafka Streams apps, scaling them via signals from a Controller in Responsive’s Control Plane. Deployable via a Helm chart into your k8s cluster. |
| Control Plane | Monitors apps, computes optimal configs for autoscaling, and provides live metrics via a Metrics API. Fully managed by Responsive. |
| Storage Backend | Offloads state to distributed databases like MongoDB, ScyllaDB, or RS3. Supports VPC-peered or provider-managed storage. DynamoDB support is coming soon. |
Get Started
SDK: Kafka Streams library extensions that enable remote state,
calling external services at scale with Async processing, and more.
Control Plane: policy-based autoscaling for your apps, one-click observability, and more.
Storage: managed storage options for your Kafka Streams state, including RS3, Responsive's cloud native object-store based state storage implementation for Kafka Streams.
Get Started >
Our Quickstart shows you how to use the SDK to run your Kafka Streams app with MongoDB in under 10 minutes.