How to Install Scala on Hadoop in Linux




Nowadays most familiar functional programming language is Scala. Scala likes a Java but little bit different. When Apache Spark enter into a picture SCALA is most scalable. Here some steps for Scala installation

Step 1: Download the Scala tarball from scala official website in your machine.

After downloading tarball will put into your Hadoop related path then will follow below step
Step 2: Extract the tar ball using below command:

tar -xzvf scala-2.11.8.tgz for extract the scala tarball

Get Scala file check whether files are there or not. Will go next step

Step 4: Update the SCALA_HOME & PATH variable in bashrc file

After an update, the SCALA_HOME and PATH will automatically environment variables are taken by the .bashrc file

Step 5: After bashrc changes, open a new terminal and check the bashrc changes using ‘ echo $SCALA_HOME  ‘ command

Open a new terminal and check above command whether scala home is updated or not

Step 6: After that Check Scala version    


How to Install Kafka on Ubuntu/Linux in Hadoop

Apache Kafka is a open source stream-processing software application developed by Apache Foundation. Here simple steps for Installation in Ubuntu\Linux operating system on Hadoop Eco system

Step 1: First step Download the Kafka tar ball from Apache Mirrors from apache official website

http://apache.mesi.com.ar/kafka/0.10.1.1/

Place If we need a specific hadoop directory  create and copy the Kafka tar ball into that directory.

Step 2: After download the kafka tar ball Extract the tar ball using below command:

tar -xzvf kafka_2.10-0.10.2.1.tgz

After extracting Apache Kafka you got Kafka Folder(Directory) including lib files and configuration files.



Step 3: After extraction Kafka tar ball we see Kafka directory 

Will need Apache kafka update the kafka home and path variables in .bashrc file follow below step simply.

Step 4: Update the KAFKA_HOME & PATH variable in bashrc file:

Step 5: After bashrc changes, open a new terminal and check the bashrc changes using ‘ echo $KAFKA_HOME  ‘ command

Apache Kafka majorly messaging system like Producers are process that publish data into Kafka topics to Consumers with the brokers. Consumer of  topics pulls the message off a topic.

After completed of Kafka Installation successfully will go to start and stop Kafka broker using below simple commands

Goto

Apache Kafka home directory and execute the command:

./bin/kafka-server-start.sh

How to stop Kafka broker through the below command :

./bin/kafkaserver-stop.sh

 

How to Fix Windows Defender(Micro Essential) Error Code : 0x80073b01

        Windows Defender (Micro Essential) :

In Windows operating system Windows Defender is a security essentials part to protect windows from Malware and Viruses. If viruses corrupt the file system like error code: 0x80073b01 of Windows Defender or Micro Essential.

In this error generally appears due to corrupted installation of Windows Defender or Micro Essential in Windows operating system.

How to Resolve Above Error code : 0x80073b01


Find below simple steps to solve the error in windows defender in windows XP /7/8/8.1/10 :

=> Edit Registry  and Repair Registry

Step 1: Open Windows Registry Editor: Press Windows Key+R to open Run

Step 2: Type : Regedit and hit Enter

Step 3HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Windows NT\Current Version\Image                       File Execution Options\”

Step 4: After that delete the entry ” msseces.exe 

Step 5 “HKEY_CURRENT_USER\Software\Microsoft\Windows\Current                                              Version\Policies\Explorer\DisallowRun” 

Step6: And delete the entry “msseces.exe

Step7: After completion of above steps then simply Restart the Windows xp/7/8/8.1/10

Check whether error code remove or not . If in the case it is not remove use PC Repair tool 

Step 1: Download and Install PC Repair tool

Step 2: After that Click on “Scan” button  to diagnose the PC

Step 3: Click the “Fix Errors”, to the fix the errors in windows defender.

Finally Windows defender is Anti-Virus software that protects to your system from virus attacks. Windows Defender most powerful Anti-spyware to remove all Malware.

 
 

How to resolve Google Chrome Crashes

At present sometimes google chrome showing Aw, Snap! error so how to solve this errors simply

  1. Check in your chrome crashes in google chrome

2. Type in browser: chrome://crashes


If no crashes showing like this 

3. If Crashes in your  google chrome showing like this

 

Please check above if errors are there in your google chrome then start or stop automatically reporting errors and crashes following below steps:

  1. Open your Google Chrome
  2. At the top right, click more : > Settings
  3. After that at the bottom showing :> Show advanced settings
  4. Under “privacy”, check or un check the box for ” Automatically send usage statistics and crash reports to Google”

(OR)

  1. Using Chrome Cleanup Tool  simple way to stop the google chrome crashes

How To Access Blocked Websites




In some colleges, offices are not accessing needed content so we need to use that content page. But we get errors like a blocked website, error not found like this.

Below methods are used for open which website is blocked and which website is an error like restrict the page while browsing the internet.

 1. Use Proxy Websites:

Restricting your access to some particular websites. At the times, you need a way to access the blocked websites and in those situations, proxy websites act as a rescue method.

Below websites are used for proxy servers for unauthorized access for any website.

https://www.proxysite.com
Proxy
http://kproxy.com/

   2. Use IP Rather Than URL

The blocked website sometimes are stored as a list of URLs and using IP of the website might work in a few of the cases. To get the IP address for any website, you do a ping command in command prompt (In Linux using Terminal) for the website is accessing or not for all users type:

check simple website whether it is working or not type below command in your command prompt.

ping www.google.com
ping www.facebook.com

 3. Change Network Proxy In Google Chrome:

Above two options are not possible then will go with below option through browsers like Google Chrome or Firefox etc.

Will go with Google Chrome for change proxy.

1. Goto “Settings” Then Click on “Show Advanced Settings”

2.Click on “Change Proxy Settings” Then LAN Settings




3. Then Clickon “Use automatic configuration script and Use a proxy server”

 

Note: Above steps are worked for Mozilla Firefox also. In my perspective using google chrome.



Summary: Some of the colleges and offices are using Tor web browser but in India blocked that Tor browser due to insecurity issues. So will follow the above steps for simple access. Do not misuse while opening the blocked site.

How to remove Autorun.inf Virus in Windows

Now, a days most familiar virus attacking in Windows system Autorun.inf file so simply will remove from the system





Simple Method:

Step 1: right Click on Command Prompt then Run as Administrator

Step 2: Type cd\ then enter

Step3: Type attrib -s -h -r autorun.inf

If virus found(Autorun.inf or FAantivirus.vbs) file in the C drive then

Step 4: Tpye  del Autorun.inf file(FAantivirus.vbs)

(OR)

Using Autorun remove tool

Step 1: Download and Install Autorum remove tool

Step 2: Put USB into you system

Windows Simple Commands

To find out IP address in windows using below command:

ip-config  




To find IP address, mac and LAN setting info using below command:

ipconfig-all

 

How to find out mac address in windows

How to find out Address Resolution Protocol

2. How to find out BCDBOOT

3. DATE

4.How to find out HOSTNAME in windows machine

5.How to find out MD HELLo

6. To communicate two machines or Network communication in Windows machine using “ping”

To check Query process in windows

REGEDIT in simple command for windows

SET command in Windows

To check system information for windows users, for Host name, version, etc info using SYSTEMINFO command

To find out version of windows

For network statistical to find network info of windows

How to Setup Cloudera Multi Node Cluster Setup




Cloudera Installation and Configure Multi Node Cluster

  1. Open Putty:

2. Type Your Machine IP address and then click on Open




3.Then Login as per Username & Password:

4. Type :  vi/etc/hosts then add remaining hosts

5. Edit: vi/etc/sysconfig/network

6. Type: vi/etc/selinux/config

SELINUX =enforcing replaced with disabled

7.Type: setenforce 0

8.Type: yum install ntp ntpdate ntp-doc: Install ntp(Netowork Time Protocol)

9. After Installation ntp then check ntp configurations type: chkconfig ntpd on

10.Type: vi/etc/ntp.conf

11.Type : ntpq -p

12.Then start the service ntpd start

13.Then ntpq

14. Then rsa pub key generator ssh-keygen-t rsa in remaining machines

15. File save as id_rsa

16.cd /root/.ssh

17.ll -check whether id_rsa.pub is there or not

18.cat id_rsa.pub>authorized_keys

19.Type: scp authorized_keys root@machine@.localdomain:/root/.ssh

20.Then type : yum install openssl python perl
21. yum clean all
22.yum repolist


23.Then download Clouder Manager using below command

wget http://archive.cloudera.com/cm5/installer/latest/cloudera-manager-installer.bin

24.chmod 700 cloudera-manager-installer.bin

25.Then type ./cloudera-manager-insatller.bin click on Next

 

26. After that Accept License

27.It will take automatically installing JDK

28. Automatically Insatlling Embedded Database

29.Cloudera manager server Insatlling

30. Installation Successfully

31.Click on “OK”

32. If you get any Error then you have disabled Firewalls and IP tables
33. Disabled firewall Type: systemctl disable firewalld

34. Disabled IPV6 Type: vi /etc/sysctl.conf

35. Browse your Machine IP:xxx.xxx.xx.xxx:7180

36.Login : Username: admin

Password:admin

37.Yes, I accept the UserLicense ” Terms and Conditions”

38. Select Cloudera Express “Free”

39.Then Search host machines using as per domain names

40. Select Repository

41. If you need any Proxy Settings then select and fill it. Don’t need leave it.

42.Click on Continue for Three machines cluster Installations. Is there any issue then choose Mozila FireFox .

43. Click on “Continue” check CDH version

44. 100% completed then click on “Continue”

45.After “Continue” then check Validations

46. Here mainly two validations are showing warnings then type below commands then Run Again

echo never > /sys/kernel/mm/transparent_hugepage/enabled
echo never > /sys/kernel/mm/transparent_hugepage/defrag
sysctl vm.swappiness=10

47. Click on “Finish”

48.It shown Version Summary

49.HDFS NameNode and ResourceManager must be different



50.Select “Core with Spark” then Continue

 

51.Click on “Test Connection”  when using embedded  Database

52.Successful Setup the Cluster.

How to Recovery Files (Pandora) from Pendrive with Pictures

How to Recovery files using Pandora

Pandora : Is a one of the best recover delete files with Pandora tool an easy to use interface. Pandora Recovery provides files recovery tool for computer and USB

Step 1 : Download Pandora Recovery file from Pandora official website.

https://www.pandorarecovery.com/

Step 2: After Downloading Pandora file then Install it


Step 2: Select Removable disk


Step 3:Then Recovery the pendrive



Step 4 :After Click on Disk 0% means recover Correctly. If 100% that file does not Recover
Step 5: Then will go “Recover to ” option


Step 6: “Recover to Specific Path then Recover Now”


Step7: Successfully Recover Files

How to Install SQOOP on Ubuntu

Apache Sqoop Installation on Ubuntu

Apache SQOOP is one of the Hadoop component. It is mainly used for data fetching from HDFS to RDBMS vice versa or bulk data between Hadoop and data stores such as relational databases.

Prerequisites :

Before you can installation of Sqoop, you have need Hadoop 2.x.x and compatible with Sqoop 1.x.x

Step 1: Download SQOOP 1.x.x tar ball from below website:

http://redrockdigimark.com/apachemirror/sqoo p/1.4.6/

Step 2: After downloading extract the SQOOP tar ball using below  command:

tar – xzvf sqoop – 1.x.x. bin – hadoop- 2.x.x – alpha.tar. gz

Step 3: Update the bashrc file with SQOOP_HOME & PATH variables

export SQOOP_HOME=/home/slthupili/INSTALL/sqoop-1.x.x.bin-hadoop-2.x.x

PATH=$PATH:$SQOOP_HOME/bin



Step 4: To check the bashrc changes, open a new terminal and type ‘echo $ SQOOP_HOME’

 

Step 5: To Integrate with MySQL Database from Hadoop Using SQOOP , we MUST have to place the respective

JAR file (mysql – connector-java5.1.38. jar) in $SQOOP _ HOME / lib path

Step 6: To check the version of SQOOP using below command:

sqoop version

Above steps are simple to installation of Sqoop on top of Hadoop in Ubuntu

To check with this video for more clarity on SQOOP Installation on Ubuntu

Sqoop to import data from a relational databases management system (RDBMS) like a  MySQL into the Hadoop Distributed File System. Sqoop automates most of this process on database to explain  about schema for the data to be imported. Sqoop uses Map Reduce to import and export the data.