| kafka-python | 纯 Python 实现,API 简单,适合中小吞吐与脚本 |
|---|---|
| confluent-kafka | librdkafka 封装,性能好、配置面广 |
| 建议 | 生产链路先核对客户端与 Broker 版本兼容矩阵 |
kafka-python 示例
kafka-python 示例
from kafka import KafkaProducer, KafkaConsumer
producer = KafkaProducer(bootstrap_servers='kafka1:9092', acks='all')
producer.send('orders', key=b'o-1001', value=b'{"amount": 9.9}')
producer.flush()
consumer = KafkaConsumer('orders',
bootstrap_servers='kafka1:9092',
group_id='order-consumer',
enable_auto_commit=False,
auto_offset_reset='earliest')
for msg in consumer:
print(msg.partition, msg.offset, msg.value)高吞吐场景优先评估 confluent-kafka;纯 Python 客户端在大量分区与高并发下 CPU 占用更高。