Apache Kafka Python Packages

pykafka

Apache Kafka client for Python; high-level & low-level consumer/producer, with great performance.

confluent-avro

An Avro SerDe implementation that integrates with the confluent schema registry and serializes and deserializes data according to the defined confluent wire format

littlehorse-client

LittleHorse Server: Workflow Engine for Microservice Orchestration & Business-as-Code, and the core of the Saddle Command Center

fink-client

Light-weight client to manipulate alerts from Fink

quantum-pipeline

A Python module for executing and monitoring quantum algorithms across local simulators and IBM Quantum platforms. Seamlessly handles data collection, organization, and streaming to Apache Kafka.

kq

Kafka-based Job Queue for Python

khaos-cli

Kafka data generator and load testing tool - generate fake messages, simulate producers and consumers, test broker failures, and run chaos engineering scenarios

esque

esque - an operational kafka tool.

streams-explorer

Explore Data Pipelines in Apache Kafka.

pyrkafka

Fast Python Kafka client powered by Rust and librdkafka — producer and consumer with native performance

typedkafka

A well-documented, fully type-hinted Kafka client for Python

samsa

Kafka Client for Kafka 0.7

pyspark-streaming-base

This project provides an opinionated way to go about crafting Spark Structured Streaming applications with PySpark

kafka-overwatch

Tool for Kafka Monitoring, Reporting, and Tuning

websites-metrics-consumer

An application that consumes metrics from Kafka messages and store the results into ta postgres db

kafka-handler

A simple Kafka wrapper based on confluent_kafka python client.

iflow-mcp-aywengo-kafka-schema-registry-mcp

A Model Context Protocol (MCP) server for Kafka Schema Registry - enables AI assistants to interact with Kafka schemas through a standardized interface

websites-metrics-collector

An application that collects metrics from websites and produce results as messages to Kafka

kafka-replay

A CLI tool to fetch Kafka messages within a specified time range