mcp-kafka

mcp-kafka

3.3

If you are the rightful owner of mcp-kafka and would like to certify it and/or have it hosted online, please leave a comment on the right or send an email to henry@mcphub.com.

mcp-kafka is a server-side implementation of the Model Context Protocol for Apache Kafka, enabling language models to interact with Kafka and its ecosystem.

Overview

mcp-kafka is a server-side implementation of the model context protocol (MCP) for Apache Kafka. It allows language models (LLM/SLM) to reliably interact with Kafka & its ecosystem, including Kafka Connect, Burrow, & Cruise Control.

NOTE: This is a WIP, changes/potential errors are expected.

Features

The server supports capabilities based on the core Kafka APIs, excluding Streams (for now), along with the Burrow & Cruise Control REST APIs.

TODO

  • Use asyncio and aiohttp.
  • Set env config values in the data class.
  • Finish admin/consumer/producer API support.
  • Support Burrow API.
  • Support CC API.
  • Service + integration tests.
  • Publish to PyPI (uv pip install mcp-kafka)
  • Test Dockerfile & push to Dockerhub (docker pull bkpowers/mcp-kafka)
  • Usage/config/deployment options + demo in README.
  • Consider Strimzi/kcctl integrations.
  • Prompts with auto-complete support for certain resources/tools.

MCP Capabilities

Tools
Kafka
  • consume
  • produce
  • describe_kafka_cluster
  • describe_kafka_topics
  • describe_kafka_consumer_groups
  • describe_kafka_delegation_tokens
  • describe_kafka_log_dirs
  • describe_kafka_configs
  • describe_kafka_acls
Kafka Connect
  • get_kafka_connect_cluster_info
  • get_kafka_connect_config
  • get_kafka_connect_connectors
  • get_kafka_connect_connector_plugins
  • get_kafka_connect_loggers
Burrow
  • burrow_healthcheck
  • burrow_list_clusters
  • burrow_describe_cluster
  • burrow_list_consumers_with_group_detail
  • burrow_list_topics
  • burrow_check_consumer_group_status
Cruise Control
  • cruise_control_get_state
  • cruise_control_get_kafka_cluster_load
  • cruise_control_get_partition_resource_utilization_and_load
  • cruise_control_get_partition_and_replica_state
  • cruise_control_get_optimization_proposals
  • cruise_control_get_user_request_result
Resources
  • topic, connector, consumer group
Prompts

Usage / Configuration

  1. Claude Desktop
  2. Cursor
  3. Windsurf
  4. Langchain MCP adapter
  5. Azure OpenAI

Environment Variables

Supported APIs are (currently) enabled by the presence of their specific environment variable. If none are present, the server responds as empty. If 1 or more variables are present, then the respective tools are also present.

  • KAFKA_BOOTSTRAP_SERVERS: Kafka Admin, Consumer, Producer APIs
  • KAFKA_CONNECT_API_URL: Kafka Connect API
  • KAFKA_BURROW_API_URL: Burrow API
  • KAFKA_CRUISE_CONTROL_API_URL: Cruise Control API