How to Install HIVE with MySQL on Ubuntu/Linux in Hadoop

Apache Hive is a data warehouse system mostly used for data summarization for structured data type files. Hive is a one of the component of Hadoop built on top of HDFS and is a data warehouse kind of system in Hadoop. It is used in Tabular form(Structured data) not for FLAT files.

Step:1 Download the hive-1.2.2 tarball from Apache Mirrors official website

http://apache.mirrors.tds.net/hive/hive-1.2.2

Step 2: Extract the tar ball file in your path using below command:




tar-xzvf Apache-hive-1.2.2-bin.tar.gz

Step 3:Update HIVE_HOME & PATH variables in bashrc file

export HIVE_HOME=/home/sreekanth/Big_Data/Apache-hive-1.2.1-bin

export PATH=$PATH:$HIVE_HOME/bin

After update, the .bashrc file will change then go to the next step

Step 5: To check the bashrc changes, open a new terminal and type the command

echo $HIVE_HOME

Step 6: Remove jline-0.9.94.jar file from the below path to avoid the incompatibility issues of Hive version with hadoop-2.6.0

Step 7: There are 2 types of Meta Stores we can configure in Hive to store metadata.



Internally using Derby in Hive. It is only for one user

Externally using MySQL is used multiple users. In case your conf file does not contain hive-site.xml file then

Create hive-site.xml  file

Step 8: Configure hive-site.xml  file with MySQL configuration and add the below content:

Step 9: For External Meta Store ‘MySQL’ , we need MySQL connector jar file

Step 10: MySQL connector jar file into $HIVE_HOME/lib path

Step 11: Run hive command in terminal but it will showing connection refused

Due to daemons are not working so it is necessary to start all daemons other wise hive is not working

Step 11: First start all daemons using start-all.sh command

Step 12: Now successfully run the hive in your machine


Step 13: How to Check Hive version using below command:

hive –version

Why we use HIVE?

Because of data summarization or querying tabular data in the Hadoop system. Default hive database Derby it is only for one user. Mostly MySQL used for large data and multiple users.

How to Configured Bridged Networking for an Existing Virtual Machine

Virtual Box is an open-source hosted hypervisor for PCs developed by Oracle. Virtual Box may be installed on a number of hosting operating systems like Windows, Linux, Mac OS, etc.




Here will Windows system has hosted and installed alongside Windows for Linux operating system

First Download and Install Virtual Box in your machine. After that will open Virtual Box then follow below steps :

Step 1: Open Virtual Box click on Settings icon

Step 2: Click on Network then will go Enable Network Adapter choose options then click on Ok

Step 3: Select  Bridged Adapter then click on OK

 

If any confusing with above steps then will go with below link

 

 

Nowadays Virtual Box is more popular because it is open-source and installed so many hosts depends upon our machine. And it is simple to download and install very simple for beginners and admins.




Virtual Box uses for the organization because running multiple operating systems simultaneously and it run more than one operating system at a time for all users. It uses without any risk and incredibly reliable and run it simply.

Network types in Virtual Box:

Bridged Networking

In mostly Bridged Networking, the guest system will receive direct access to the network to host system connected directly

NAT Service

First NAT means Network Address Translation service for communication in between Host and guest systems. It is like a router and directly access to host systems from guest systems. The NAT service-connected in Internal networking like LAN and Intranet.

Host-Only Networking

In Host-only networking communication between guest systems and the host system is connected but we need customized network interfaces.

Internal Networking

In Internal Networking communication between guest systems and the host system connected is possible. Here also we need customized network interface will be used in between Host and Guest Host system.

How to resolve Failed to open a session for the virtual machine Error code :0x80004005 with Pictures

In the Windows operating system try to open Linux machines so will try with Virtual Machines, Virtual Box. But some times I opened Virtual Box got this type of error code: 0x80004005 on Windows.




Here are simple steps to resolve this error code with screenshots.

Step 1: Open Virtual Box with Run as administrator. Then it showing below snapshot error: 0x80004005 belongs to Failed to open a session for the virtual machine. Check with this error correct or not.

Step 2:  After the check, this type of error on top of the left showing options are like New, Settings, Start button. Now, go with Start button then choose options from Strat button.

Step 3: After clicks on Select button options go with the Headless Start option. Click on Headless start button simply.

Step 4: After click on Headless start button. It will automatically redirect to again Start button. So now click on Start button simply. Now, start button acts like a Headless start button.

Step 5: Now, the issue may be solved. If an issue is still pending then close it Virtual Box. Then open with Headless start option. It means that Restart the Virtual Box.

Note: If successfully done with above steps then login with your Virtual Box credentials. If an error is still pending failed to open a session for the virtual machine Error code: 0x80004005 then first restart Virtual Box after that restart Windows operating system also.




Summary: Nowadays VirtualBox usages are rapidly increasing due to needs to another machine along with other operating systems. Everyone wants to Windows and Linux machine in Computer so Virtual Boxes are needy. Sometimes Virtual Box gets some issues like Network issue with error code. Here is Virtual Box starting problem with Error code: 0x80004005. So provided resolutions with pictures for easily solve to the issue.

How to Install Ubuntu\Linux on VirtualBox

Virtual Box is an open-source hosted hypervisor for PCs developed Oracle it handles running multiple operating systems simultaneously.




You have Windows operating system but you want to Ubuntu but you don’t need alongside with your windows so first install Virtual box after that will go with Ubuntu iso installation.

How to Install Ubuntu on Virtual Box Simple Steps for beginners

Step 1: Open Virtual Box and Click on New button.

Step 2: Enter your operating System Name dependents upon Ubuntu/Linux or Fedora  your operating system

Step 3: Select your Memory size depends on your machine Hard Disk.

 

Step 4:  After that Click on Create a Virtual hard disk

 

 

Step 5: Choose your option whether your file belongs whether Image file or Disk file

 

Step 6: Storage on Physical hard disk select Dynamically allocated because some times Fixed size is not comfortable

Step 7: Select File location and Size for per your requirement

Step 8: Right-click on your Ubuntu/Linux image then will go with the start

 

Step 9: After that start, button click on Normal Start

Step 10: Browse your Ubuntu iso file

Step 11: If you need any changes to press F12 boot device otherwise leave it

Step 13: Loading ISO file

Step 14: Click on Install Ubuntu will go with next steps




Step 15: Check the “Erase disk and Install Ubuntu in Virtual Box.

Step 16: Create a User name and Password

Step 17: After Installation Complete Restart Now 

Step 18: Enter your Password

Step 19: Successfully completed Ubuntu\Linux on Virtual Box

Step 20: If you want to close your Virtual Machine click on Power off the machine

In this video explain how to install Ubuntu alongside Windows on Virtual Box simple steps :

Virtual Box is nowadays more popular because it is open-source software and installed many hosts depends upon your machine and it uses without any risk and incredibly reliable and runs it simply.

How to Install SpringToolSuite(STS) with Scala on Windows 7/8/10

Java is an open source programming language for software developers and coming to Spring Boot is an advanced framework in Spring. So how to develop in using Spring Tool Suite IDE in a simple way. Here is how to install STS simple steps and how to install SCALA on Spring Tool Suite IDE. Mainly how to integrate Scala with STS for Scala developers without Scala IDE.

In this STS both using Java developers as well as Scala developers.

Prerequisites: Java (JDK 1.7) is mandatory to install STS along with SCALA.

How to Install STS with SCALA on Windows:

Step 1: Download STS  zip file from spring official website

https://spring.io/tools/sts/all

Step 2: After downloading Spring Tool Suite zip file then extract that then Open STS directory file click on STS icon below like this.

Step 3:  Run that file then Select a directory as a workspace and browse your directory.

Step 4: After that open workspace spring Dashboard for more information.

Step 5: Go to Top menu bar and click on Help option then click on Eclipse Marketplace.

Step 6: After open Eclipse Market Place then search Scala IDE and click on Install option.

Step 6: Click on I Accept Apache License & agreement then Click on Finish button.

Step 7: After that Restart Spring Tool Suite IDE then start with SCALA simply.

Above steps are simple to integrate SCALA in Eclipse or Spring Tool Suite for developers. If you don’t need this type SCALA installation then go with SCALA IDE from Scala official website.

How to Install Hadoop in Ubuntu/Linux in Single Node Cluster

Nowadays most emerging technology Hadoop. Is a solution for Big data to store and process a large amount of data. For storage purpose HDFS and Processing in Map Reduce but nowadays Map Reduce is not used. Will move to Apache Spark for processing and 100% better than Map Reduce because it is based on c

Step 1: First step we need to update the “System Software Repositories” using below command:
sudo apt-get update

Step 2: Next will Install java-1.8 version using below command.

sudo apt-get install openjdk-8-jdk

Step 3: After that check Java Version using below command:

java -version

Step 4: We must and should Install ssh using below command

sudo apt-get install ssh

Password Less SSH Communication, enter the below commands at any terminal:

ssh localhost

ssh-keygen -t rsa -P ” -f ~/.ssh/id_rsa
cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys

 

STEP 5: Download Hadoop-2.6.0 version tar ball from Apache Mirrors from Apache official website

STEP 6: Extract the copied tar ball using below command:

tar -xzvf hadoop-2.6.0.tar.gz

Below are the Total Configuration files in ‘Hadoop’ directory

STEP 7: We must and should to do edit the below 8 configuration files as part of HADOOP Installation:
1. core-site.xml

2. mapred-site.xml

3. mapred-env.sh

4. yarn-site.xml

5. hdfs-site.xml

6. hadoop-env.sh

7. yarn-env.sh

8. slaves

 

STEP 8: Open  core-site.xml file, add the below  properties

STEP 9: Open “hadoop-env.sh” file and update JAVA_HOME path

 

STEP 10: Open mapred-env.sh and update JAVA_HOME

STEP 11: Open hdfs-site.xml  file and add the below properties:

STEP 12: Open mapred-site.xml and update the framework architecture details as “yarn”

STEP 13: Open yarn-env.sh and update JAVA_HOME path in that file

STEP 14: Open yarn-site.xml and add the below properties to configure “Resource Manager”.

STEP 15: Open slaves file and to check whether the hostname is localhost or not

STEP 16: Update and Set JAVA_HOME, HADOOP_HOME & PATH variables:

export JAVA_HOME=/usr/lib/jvm/java-7-openjdk-amd64

export HADOOP_HOME=/home/gopalkrishna/INSTALL/hadoop-2.6.0

export PATH=$PATH:$JAVA_HOME/bin:$HADOOP_HOME/sbin

STEP 17: To check the bashrc changes, open a new terminal and type the below command:

echo $HADOOP_HOME

STEP 18: Before starting Name Node, we must have to format the name node using below command:

hadoop namenode -format

STEP 19: To start all the daemons of hadoop in 2.X.X use “start-all.sh” command

Step 20: How to check Name node, Node manager, Data node running or not will use below command:

simply using:  jps

STEP 21: To Access the Name Node information in GUI using below link in your systerm

http://localhost:50070

STEP 22: To Start Job History Server in Hadoop Cluster using below command

mr-jobhistory-daemon.sh start historyserver

STEP 23: To Access Resource Manager in Hadoop cluster:

localhost:8088

STEP 24: To Access Job History Server in Hadoop Cluster

localhost:19888

STEP 25: To stop all the daemons of hadoop in 2.X.X use “stop-all.sh” command

STEP 26: To Stop Job History Server in 2.x.x.

mr-jobhistory-daemon.sh stop historyserve

How to Install Scala on Hadoop in Linux

Nowadays most familiar functional programming language is Scala. Scala likes a Java but little bit different. When Apache Spark enter into a picture SCALA is most scalable. Here some steps for Scala installation

Step 1: Download the Scala tarball from scala official website in your machine.

After downloading tarball will put into your Hadoop related path then will follow below step
Step 2: Extract the tar ball using below command:

tar -xzvf scala-2.11.8.tgz for extract the scala tarball

Get Scala file check whether files are there or not. Will go next step

Step 4: Update the SCALA_HOME & PATH variable in bashrc file

After an update, the SCALA_HOME and PATH will automatically environment variables are taken by the .bashrc file

Step 5: After bashrc changes, open a new terminal and check the bashrc changes using ‘ echo $SCALA_HOME  ‘ command

Open a new terminal and check above command whether scala home is updated or not

Step 6: After that Check Scala version    

How to Install Kafka on Ubuntu/Linux in Hadoop

Apache Kafka is a open source stream-processing software application developed by Apache Foundation. Here simple steps for Installation in Ubuntu\Linux operating system on Hadoop Eco system

Step 1: First step Download the Kafka tar ball from Apache Mirrors from apache official website

http://apache.mesi.com.ar/kafka/0.10.1.1/

Place If we need a specific hadoop directory  create and copy the Kafka tar ball into that directory.

Step 2: After download the kafka tar ball Extract the tar ball using below command:

tar -xzvf kafka_2.10-0.10.2.1.tgz

After extracting Apache Kafka you got Kafka Folder(Directory) including lib files and configuration files.

Step 3: After extraction Kafka tar ball we see Kafka directory 

Will need Apache kafka update the kafka home and path variables in .bashrc file follow below step simply.

Step 4: Update the KAFKA_HOME & PATH variable in bashrc file:

Step 5: After bashrc changes, open a new terminal and check the bashrc changes using ‘ echo $KAFKA_HOME  ‘ command

Apache Kafka majorly messaging system like Producers are process that publish data into Kafka topics to Consumers with the brokers. Consumer of  topics pulls the message off a topic.

After completed of Kafka Installation successfully will go to start and stop Kafka broker using below simple commands

Goto

Apache Kafka home directory and execute the command:

./bin/kafka-server-start.sh

How to stop Kafka broker through the below command :

./bin/kafkaserver-stop.sh

How to Fix Windows Defender(Micro Essential) Error Code : 0x80073b01

        Windows Defender (Micro Essential) :

In Windows operating system Windows Defender is a security essential part to protect windows from Malware and Viruses. If viruses corrupt the file system like error code: 0x80073b01 of Windows Defender or Micro Essential.

In this error generally appears due to a corrupted installation of Windows Defender or Micro Essential in Windows operating system.

How to Resolve Above Error code : 0x80073b01

Find below simple steps to solve the error in windows defender in windows XP /7/8/8.1/10 :

=> Edit Registry  and Repair Registry

Step 1: Open Windows Registry Editor: Press Windows Key+R to open Run

Step 2: Type : Regedit and hit Enter

Step 3HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Windows NT\Current Version\Image                       File Execution Options\”

Step 4: After that delete the entry ” msseces.exe 

Step 5 “HKEY_CURRENT_USER\Software\Microsoft\Windows\Current                                              Version\Policies\Explorer\DisallowRun” 

Step6: And delete the entry “msseces.exe

Step7: After completion of above steps then simply Restart the Windows xp/7/8/8.1/10

Check whether error code remove or not . If in the case it is not remove use PC Repair tool 

Step 1: Download and Install PC Repair tool

Step 2: After that Click on the “Scan” button  to diagnose the PC

Step 3: Click the “Fix Errors”, to fix the errors in windows defender.

Finally, Windows defender is Anti-Virus software that protects your system from virus attacks. Windows Defender most powerful Anti-spyware to remove all Malware.

 
 

How to resolve Google Chrome Crashes

At present sometimes google chrome showing Aw, Snap! error so how to solve these errors simply

  1. Check in your chrome crashes in google chrome

2. Type in browser: chrome://crashes

If no crashes showing like this 

3. If Crashes in your  google chrome showing like this

 

Please check above if errors are there in your google chrome then start or stop automatically reporting errors and crashes following below steps:

  1. Open your Google Chrome
  2. At the top right, click more : > Settings
  3. After that at the bottom showing :> Show advanced settings
  4. Under “privacy”, check or un check the box for ” Automatically send usage statistics and crash reports to Google”

(OR)

  1. Using Chrome Cleanup Tool  simple way to stop the google chrome crashes