How to Install Kafka on Ubuntu/Linux in Hadoop





Apache Kafka is an open-source stream-processing software application developed by Apache Foundation. Here simple steps for Installation in Ubuntu\Linux operating system on Hadoop Ecosystem

Step 1: First step Download the Kafka tarball from Apache Mirrors from apache official website

http://apache.mesi.com.ar/kafka/0.10.1.1/

Place If we need a specific Hadoop directory to create and copy the Kafka tarball into that directory.

Step 2: After download, the Kafka tarball Extract the tarball using the below command:

tar -xzvf kafka_2.10-0.10.2.1.tgz

After extracting Apache Kafka you got Kafka Folder(Directory) including lib files and configuration files.

Step 3: After extraction Kafka tarball we see Kafka directory 

We will need Apache Kafka to update the Kafka home and path variables in .bashrc file follow below step simply.

Step 4: Update the KAFKA_HOME & PATH variable in bashrc file:

Step 5: After bashrc changes, open a new terminal and check the bashrc changes using ‘ echo $KAFKA_HOME  ‘ command

Apache Kafka’s majorly messaging system like Producers is the process that publishes data into Kafka topics to Consumers with the brokers. The consumer of topics pulls the message off a topic.

After completed of Kafka Installation successfully will go to start and stop Kafka broker using below simple commands

Goto

Apache Kafka home directory and execute the command:

./bin/kafka-server-start.sh

How to stop Kafka broker through the below command :

./bin/kafkaserver-stop.sh



Leave a Reply

Your email address will not be published. Required fields are marked *