Step By Step : Installing Kafka in Mac

Sudhir Pradhan Trending September 12, 2017 | 0

Post Views: 3,624

Open “Terminal” app from Applications or Command + Space and then type “Terminal” press Enter/Return Key

Install Homebrew (Copy / Paste the following command in the Terminal window and press enter)

ruby -e "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install)" < /dev/null 2> /dev/null

Now install Kafka(Copy / Paste the following command in the Terminal window and press enter)

```
brew install kafka
```
Sample Output of above command :

==> Installing dependencies for kafka: zookeeper

==> Installing kafka dependency: zookeeper

==> Downloading https://homebrew.bintray.com/bottles/zookeeper-3.4.10.sierra.bottle.tar.gz

######################################################################## 100.0%

==> Pouring zookeeper-3.4.10.sierra.bottle.tar.gz

==> Caveats

To have launchd start zookeeper now and restart at login:

 brew services start zookeeper

Or, if you don't want/need a background service you can just run:

 zkServer start

==> Summary

🍺 /usr/local/Cellar/zookeeper/3.4.10: 241 files, 31.4MB

==> Installing kafka

==> Downloading https://homebrew.bintray.com/bottles/kafka-0.11.0.0.sierra.bottle.tar.gz

######################################################################## 100.0%

Now list all services

```
brew services list
```
Sample output of above command

spradhan-macos:/ sudhir.pradhan$ brew services list
Name Status User Plist
kafka stopped
mysql stopped
postgresql started sudhir.pradhan /Users/sudhir.pradhan/Library/LaunchAgents/homebrew.mxcl.postgresql.plist
presto stopped
redis started sudhir.pradhan /Users/sudhir.pradhan/Library/LaunchAgents/homebrew.mxcl.redis.plist
zookeeper stopped

From above output it seems the kafka installed but not running
So before starting Kafka, make sure we the ZooKeeper is running

Lets start ZooKeeper

```
brew services start zookeeper
```

Sample output

spradhan-macos:/ sudhir.pradhan$ brew services start zookeeper
==> Successfully started `zookeeper` (label: homebrew.mxcl.zookeeper)

Now start Kafka (From above output we made sure the Zookeeper is running)

```
brew services start kafka
```

Sample output

spradhan-macos:/ sudhir.pradhan$ brew services start kafka
==> Successfully started `kafka` (label: homebrew.mxcl.kafka)

Lets verify if our required services are running

```
brew services list
```
Sample output

spradhan-macos:/ sudhir.pradhan$ brew services list
Name Status User Plist
kafka started sudhir.pradhan /Users/sudhir.pradhan/Library/LaunchAgents/homebrew.mxcl.kafka.plist
mysql stopped
postgresql started sudhir.pradhan /Users/sudhir.pradhan/Library/LaunchAgents/homebrew.mxcl.postgresql.plist
presto stopped
redis started sudhir.pradhan /Users/sudhir.pradhan/Library/LaunchAgents/homebrew.mxcl.redis.plist
zookeeper started sudhir.pradhan /Users/sudhir.pradhan/Library/LaunchAgents/homebrew.mxcl.zookeeper.plist

Lets create a topic named “test”

kafka-topics --create --zookeeper localhost:2181 --replication-factor 1 --partitions 4 --topic test

Sample output

spradhan-macos:/ sudhir.pradhan$ kafka-topics --create --zookeeper localhost:2181 --replication-factor 1 --partitions 4 --topic test
Created topic "test".

Desctibe above created topic
- ```
kafka-topics.sh --describe --zookeeper localhost:2181 --topic
```
- Sample output
- spradhan-macos:/ sudhir.pradhan$ kafka-topics –describe –zookeeper localhost:2181 –topic test
- Topic:test PartitionCount:4 ReplicationFactor:1 Configs:
- Topic: test Partition: 0 Leader: 0 Replicas: 0 Isr: 0
- Topic: test Partition: 1 Leader: 0 Replicas: 0 Isr: 0
- Topic: test Partition: 2 Leader: 0 Replicas: 0 Isr: 0
- Topic: test Partition: 3 Leader: 0 Replicas: 0 Isr: 0

Start Producer and Consumer in 2 different terminal window

in terminal 1:

kafka-console-producer --broker-list localhost:9092 --topic test

in terminal 2:

kafka-console-consumer --broker-list localhost:9092 --topic test

Now Publish message to the above topic in Terminal 1
1. spradhan-macos:/ sudhir.pradhan$ kafka-console-producer –broker-list localhost:9092 –topic test
  >Hi There
  >
Now check in Terminal 1 if the consumer received the message
1. spradhan-macos:/ sudhir.pradhan$ kafka-console-consumer –bootstrap-server localhost:9092 –from-beginning –topic test
  Hi There
2. Yehhhh … there you go

Hope you enjoyed the article. Please like or comment.

You can enroll now !We are giving 30% discount on our Internship Program

Don’t miss the chance to participate in the upcoming Internship Program which will be done using Microsoft Dot Net Web Development Full Stack Technology. The new batch will be starting from May 20, 2024. We will have most experienced trainers for you to successfully complete the internship with live project experience.

Why to choose Our Internship Program?

Industry-Relevant Projects
Tailored Assignments: We offer projects that align with your academic background and career aspirations.
Real-World Challenges: Tackle industry-specific problems and contribute to meaningful projects that make a difference.

Professional Mentorship
Guidance from Experts: Benefit from one-on-one mentorship from seasoned professionals in your field.
Career Development Workshops: Participate in workshops that focus on resume building, interview skills, and career planning.

Networking Opportunities
Connect with Industry Leaders: Build relationships with professionals and expand your professional network.
Peer Interaction: Collaborate with fellow interns and exchange ideas, fostering a supportive and collaborative environment.

Skill Enhancement
Hands-On Experience: Gain practical skills and learn new technologies through project-based learning.
Soft Skills Development: Enhance communication, teamwork, and problem-solving skills essential for career success.

Book Your Seat Now

Free Demo Class Available

apache kafka install kafka in mac Installing Kafka in Mac kafka kafka and mac kafka in macbook