Kafka Consumer Python Packages

kafkian

An opinionated Kafka producer/consumer built on top of confluent-kafka-python/librdkafka

cmem-plugin-kafka

Send and receive messages from Apache Kafka.

kq

Kafka-based Job Queue for Python

kafka-influxdb

High performance Kafka consumer for InfluxDB. Supports collectd message formats.

khaos-cli

Kafka data generator and load testing tool - generate fake messages, simulate producers and consumers, test broker failures, and run chaos engineering scenarios

pyrkafka

Fast Python Kafka client powered by Rust and librdkafka — producer and consumer with native performance

fastapi-kafka

A Kafka wrapper class around FastAPI to create consumers as endpoints.

kafka-handler

A simple Kafka wrapper based on confluent_kafka python client.

the-trial

A microframework designed to provide a simple interface for interacting with Kafka

kafkatop

Monitor kafka consumer lags and event rates

kafka-replay

A CLI tool to fetch Kafka messages within a specified time range

kafka-framework

A FastAPI-inspired framework to build production-grade Kafka applications effortlessly, with support for routing, DI, retries, DLQ, and custom serialization.

pyallel-consumer

Parallel Apache Kafka client wrapper with per message ACK, client side queueing, a simpler consumer/producer API with key concurrency and extendable non-blocking IO processing.