@venkateshdotdev: Kafka is easy to learn. Until you have to actually use it. 😅 Partitions, consumer groups, offsets, Kafka Connect, Stre…

Kafka is easy to learn.

Until you have to actually use it. 😅

Partitions, consumer groups, offsets, Kafka Connect, Streams, CDC…

That’s where things get interesting.

So I collected 10 GitHub repositories that can actually help you get better at Kafka.

🧵👇

1. Apache Kafka

https://github.com/apache/kafka

Start here if you want to understand Kafka beyond “producer.send()”.

The repo contains Kafka itself, documentation, examples and the actual implementation.

Don’t just read the README.

Try to understand:

→ Producers & consumers → Partitions → Replication → Consumer groups → KRaft → Kafka Streams

Want to understand how Kafka actually works under the hood?

This is the repo to explore.

2. Kafka Streams Examples

https://github.com/confluentinc/kafka-streams-examples…

If you’re learning Kafka Streams, don’t just watch tutorials.

Read working examples.

You’ll find examples for:

→ Filtering & transformations → Joins → Aggregations → Stateful processing → Windowing → Testing → Docker-based examples

Pick one example.

Run it.

Then break it.

That’s where the real learning starts.

3. Debezium

https://github.com/debezium/debezium…

Want to understand CDC?

Start here.

Debezium captures database changes and turns them into events that applications can consume.

Great for learning:

→ Change Data Capture → Kafka Connect → Database → Kafka pipelines → Event-driven architecture → Transaction logs

Imagine updating one row in PostgreSQL…

and watching that change become a Kafka event.

That’s the kind of thing you should build while learning Kafka.

4. Debezium Examples

https://github.com/debezium/debezium-examples…

The main Debezium repo can feel huge.

This one is much more hands-on.

It contains examples for:

→ PostgreSQL CDC → Audit logs → Cache invalidation → Kafka Connect → Data pipelines → CloudEvents → RAG + CDC

If you’re someone who learns by building instead of reading…

bookmark this one.

5. Kafbat UI

https://github.com/kafbat/kafka-ui

Kafka CLI is powerful.

But sometimes you just want to SEE what’s happening.

Kafbat UI gives you a web interface to inspect Kafka clusters.

You can explore:

→ Brokers → Topics → Partitions → Consumer groups → Consumer lag → Messages → Connectors → Schema Registry

If you’re debugging Kafka locally, this can save you a lot of time.

Would you use a Kafka UI or stick with the CLI? 👀

6. AKHQ

https://github.com/tchiotludo/akhq

Another really useful Kafka GUI.

AKHQ lets you manage and inspect:

→ Topics → Messages → Consumer groups → Schema Registry → Kafka Connect

It’s especially useful when you’re running Kafka locally and want visibility into what’s happening inside the cluster.

Don’t just produce messages.

Look at what Kafka is actually doing with them.

7. Strimzi

https://github.com/strimzi/strimzi-kafka-operator…

Running Kafka on Kubernetes?

You should know Strimzi.

It provides Kubernetes operators for deploying and managing Kafka clusters.

Use it to learn:

→ Kafka on Kubernetes → Operators → KafkaNodePool → Listeners → Storage → Kafka users & ACLs → Kafka Connect

This is where Kafka starts moving from…

“local Docker project”

to

“production infrastructure.”

8. Kafka Proxy

https://github.com/grepplabs/kafka-proxy…

Here’s a repo you might not see in beginner Kafka lists.

Kafka Proxy helps clients connect to Kafka without directly dealing with things like:

→ TLS certificates → SASL authentication → Broker networking → Kubernetes networking

It’s also a great repo to study if you’re interested in Kafka networking and security.

Sometimes the best way to learn a system…

is to study the problems around it.

9. Confluent Examples

https://github.com/confluentinc/examples…

This is basically a playground of Kafka examples.

You’ll find examples around:

→ Kafka Connect → Schema Registry → Debezium → Kafka Streams → ksqlDB → Docker → Monitoring → Event-driven applications

Don’t try to go through everything.

Pick one architecture that interests you.

Build it locally.

Then change one component and see what breaks. 👀

10. Confluent Demo Scene

https://github.com/confluentinc/demo-scene…

This one is packed with practical Kafka demos.

You’ll find projects around:

→ Kafka Connect → Kafka Streams → ksqlDB → Kafka → Elasticsearch → Kafka → S3 → Kafka → Database → Fraud detection → Interactive queries

Perfect when you don’t know what to build next.

Open a demo.

Run it.

Understand the architecture.

Then build your own version.

That’s how you go from “I know Kafka”

to

“I can actually use Kafka.”

If you’re learning Kafka, don’t bookmark this thread and forget it. 😂

Pick ONE repository.

Clone it.

Run it locally.

Break something.

Fix it.

Then move to the next one.

That’s going to teach you Kafka much faster than watching another 8-hour course.

Which repo are you starting with? 👇

Yea, but once implemented it saves a lot of problems