rvrdata.adapters.kafka

Adapter for working with Apache Kafka.

Apache Kafka is an open-source distributed event streaming platform (see https://kafka.apache.org). This adapter wraps kafka-python client enabling it to act as a kafka producer or a consumer.

class RvrdataKafka

Kafka adapter for admin, producer and consumer actions.

force_pass()

Fake successful action that does nothing (used for testing dry-runs).

bootstrap_connected()

Bootstrap connection check.

create_topics()

Create given topics in the broker.

delete_topics()

Delete given topics from the broker.

list_topics()

List topics from the broker.

describe_topics()

Describe requested topics.

describe_cluster()

Describe cluster.

partitions_for()

Return known set of partitions for topic.

flush()

Flush all records to send.

send()

Publish message to a topic.

topics()

Get topics authorized to view.

Subscribe to list of topics.

unsubscribe()

Unsubscribe from all topics and clear partitions.

assignment()

Get topic partitions assigned to consumer.

poll()

Fetch data from assigned topics.