Skip to content Skip to sidebar Skip to footer
Showing posts with the label Apache Kafka

Spark Streaming: Read Csv String From Kafka, Write To Parquet

There are lots of online examples of reading json from Kafka (to write to parquet) - but I cannot f… Read more Spark Streaming: Read Csv String From Kafka, Write To Parquet

Not Able To Access Messages From Confluent Kafka On Ec2

Confluent Kafka 5.0.0 has been installed on AWS EC2 which has Public IP say 54.XX.XX.XX Opened port… Read more Not Able To Access Messages From Confluent Kafka On Ec2

Kafka-python Read From Last Produced Message After A Consumer Restart

i am using kafka-python to consume messages from a kafka queue (kafka version 0.10.2.0). In particu… Read more Kafka-python Read From Last Produced Message After A Consumer Restart

Kafka Consumer Losing State Of Messages After Shutdown

Thanks for taking time to answer the question. I am using kafka with a python consumer. Everything … Read more Kafka Consumer Losing State Of Messages After Shutdown

Nobrokersavailable: Nobrokersavailable-kafka Error

i have already started to learn Kafka. Trying basic operations on it. I have stucked on a point whi… Read more Nobrokersavailable: Nobrokersavailable-kafka Error

How To Connect Python Consumer To Aws Msk

I'm trying to connect my python consumer to AWS MSK cluster. how can I do that? Have an AWS MSK… Read more How To Connect Python Consumer To Aws Msk

Kafka-python Consumer Start Reading From Offset (automatically)

I'm trying to build an application with kafka-python where a consumer reads data from a range o… Read more Kafka-python Consumer Start Reading From Offset (automatically)

How To Consume Messages Using Beam's External Kafka Transform (locally)

I am trying to run an app that uses a kafka producer (Python client), and an apache beam pipeline t… Read more How To Consume Messages Using Beam's External Kafka Transform (locally)