How to Install Hadoop Single Node Cluster

How to Install Hadoop Single Node Cluster on Ubuntu.

Step 1: Update the “System Software Repositories” using sudo apt-get update

First step update the packages of Ubuntu


Step 2: JAVA 1.8 JRE INSTALLATION using below command.

JAVA is prerequisite for Installation so first install JRE then will go with JDK

 

Step 3: JAVA 1.8 JDK INSTALL using below command

 

Step 4: How to check JAVA version on Linux using below command

Step 5: After that We must and should Install SSH(Secure Shell) using below command:

SSH for secure less communication in name node and secondary name node for frequently communication

Step 6: Check  SSH Installation using below command

After installation of SSH will check using ssh localhost command whether communication is working or not.

Step 7: Download Hadoop-2.6.0 tarball from Apache Mirrors.

After completion of Hadoop prerequisites then download hadoop tar ball

Step 8: Extract the tar ball using below command

 

Step 9: Update Environment variables and Path for HADOOP_HOME and JAVA_HOME:

 

 

Step 10: To check Path variable is there or not after that edit the Configuration files as part of Hadoop Installation.

 

 

Step 11: First open “Core-site.xml” file, add the properties

Core-site file for Name node information

Step 12: Open “hdfs-site.xml” file and add the properties

Hdfs site xml file related to replication factor and data node information.

Step 13: Open “yarn-site.xml” file and add the properties to configure ‘Resource Manager’ & ‘Node Manage’ details:

Step 14: Update JAVA_HOME path in ‘ hadoop-env.sh’ file

Step 15:Update JAVA_HOME path in ‘ mapred-env.sh‘ file

Step 16: Open ‘mapred-site.xml‘ and update the yarn into that file

Step 17: Open slaves file and check whether the hostname is localhost or not

Step 18: Before starting Name Node, we must and should format the name node using below command: hadoop namenode -format

Step 19: To start all the daemons of hadoop using below command:

start-all.sh

Step 20: How to check daemons whether work or not using jps command





Step 21: After that all to access the Name Node information in GUI:

http://localhost:50070

 

 

How to Install Cassandra on Ubuntu/Linux in Hadoop Eco-System

How to Install Apache Cassandra on Ubuntu in Hadoop Eco – System

Apache Cassandra is a open source, distributed, NoSQL database management system designed to handle huge amount of data across in cheapest servers. It provides high availability written in JAVA for data processing.

Why should we use Apache Cassandra

Now a days Cassandra is complete NoSQL database and robust deployed by some of social networks like Facebook, Twitter, and e-commerce.

1.Cassandra supports for a wide set of data structures.

2. Scalable architecture.

3. Cassandra is High reliability

4. And Cassandra supports ACID properties.


Prerequisites for Apache Cassandra Installation :

Cassandra requires a number of installations. First we need JAVA and Python 2.7 is also mandatory

Below step by step process for Cassandra installation on Ubuntu

Step 1: Download Cassandra-2.x.x-bin.tar.gz from below website: http://cassandra.apache.org/download

First download tar ball from Cassandra official website

Step2:  Extract the downloaded Tarball using below command

tar-xzvf cassandra-2.x.x-bin.tar.gz

Step 3: After that Update the CASSANDRA_HOME and PATH Variables in bashrc file

CASSANDRA_HOME=/home/slthupili/INSTALL/dsc-cassandra-2.2.8
export PATH=$PATH:$CASSANDRA_HOME/bin

Step 4: To check whether bashrc change or not, after that a open new terminal and type‘echo $CASSANDRA_HOME’ command

 

Step 5: After completed above settings start Cassandra Server, use below command:

cassandra

Step 6: If start with Cassandra Query Language Shell using below command:

cqlsh

Characteristics of  Cassandra:

1.Cassandra is a cloumn – oriented database and fault tolerant

2.It is a highly consistent and Scalable.

3. Cassandra was created at Face Book  and data model is based on Google Big Data.

 

Summary:

In this Apache Cassandra Installation tutorial simple steps to installations with pictures and basic knowledge on Cassandra

 

 

 

 

 

How to Install Apache Spark on Ubuntu/Linux

Apache Spark Installation

Spark is a framework and in memory data processing engine. Compare with Hadoop Map Reduce 100 times faster for data processing.  Developed in Java, Scala, Python and R languages. Now a days mostly working and execute the data in Streaming, Machine Learning.

Prerequisite of Spark Installation:

1. Update the packages on Ubuntu using

sudo apt – get update

After entering your password it will update some packages

2.  Now you can install the JDK for Java installation

sudo apt – get install default – jdk

Java version must be greater than 1.6 version

Step 1 : Download spark tar ball  from Apache spark official website



Step 2: Tar ball file into your  Hadoop directory

Step 3 : After that Extract the Downloaded tarball using below command:

tar -xzvf  spark tar ball

Step 4:  After tarball extraction , we get Spark directory and Update the SPARK_HOME & PATH variables in bashrc file

using below commands:

export SPARK_HOME=/home/slthupili/INSTALL/spark-2.x.x-bin-hadoop2.x

export PATH=$PATH:$SPARK_HOME/bin

Step 5 : To check the bashrc changes, open a new terminal and type ‘echo $SPARK_HOME command

Step 6: After successfully Installation of Spark, Will check with Spark shell in terminal using below command :

Spark-shell

 

Step 7: To check spark version and scala version using below commands:

Scala>spark.version

Scala>sc.version

 

Check with this video for any confusing while installation of Apache Spark

 

Above steps are very simple to installation of Apache Spark on top of Hadoop in a single node cluster.

 

 

How to Remove Short Cut Virus on Windows

Remove Short Cut Virus on Windows

How to remove shortcut virus in windows simple steps for how to copy files from virus pen drive in Windows

#)USB shown like this below

Method 1:

simple step :

In search box we enter .(dot) then it showing files




Then copy the required files from pen drive to Windows machine.

Method 2:

1 . Open Windows menu and open command prompt with Run  as Administrator.

2. After that open external drivers like USB then Connect to Your USB storage into a computer or PC.

3. In command prompt type below command:

attrib -h -r -s/s/d F:\*.*

Then separate files each and every one below like this

4) After separation each and every file then required file copy into your computer.  Then Delete Virus contain files:

After completion of above steps then copy required files.

In Windows Operating System short cut Virus one of the malware to destroy files and system from external storage devices, like USB drives, external hardware drives, memory cards etc.

This virus affects more on files stored on a USB but infected drive to entire computer run the software and a new folder will be created with all of your existing files in your computer or USB.

 

 

How To Enable the Team Viewer on Windows

Team Viewer on Windows

How to Remote accessing one system to another system by using Team Viewer. Here is simple steps to Install of Team Viewer

Step 1: Download Team Viewer and Install

First Download Team Viewer file from official website other wise click on below link will directly go to team viewer site.

https://www.teamviewer.com/en/download/windows/

Step 2: Install the file and Open the Team Viewer:

After downloading team viewer file then install it. After installation then simply open team viewer.





Upon installing the application, a partner ID is generated. This is a nine digit code that allows whoever has it to connect to that computer or device

To connect to a remote computer or device using the partner ID, first open the Team Viewer desktop application on the target computer or device and write down the ID and the password.

Step 3: Remote Control

Next, launch the Team Viewer Touch app and insert the partner ID in the dedicated field, on the upper left hand corner of the screen. Then, press the Remote Control button

When the connection is established you are asked to type in the password in the dedicated field. Type it in and press OK.

Above steps are very simple to installation and Remote access to another machine whether Windows or Ubuntu.

 

How To Enable Remote Desktop Connections on Windows

Remote Desktop Connections on Windows

In Windows machines we need to access and transferring files from one machine to another machine simple without any software. Follow below steps for enable remote in your windows.

Step :1 Open Computer—>Properties

After open properties on windows then go to remote settings

Step :2 Click on Remote Settings



Step :3 Click on Allow connections only from computer running Remote Desktop then Click on Select Users

Step :4 This opens the Remote Desktop Users window. To add the users to whom you want to give permissions, click or tap Add.
Step :5 In the Select Users window, type the user account name in the box in the next window and click or tap Check Names
Step :6 Windows will make sure that a user account with that name exists and add the location in front of it
Step :7 You are back to the Remote Desktop Users window. Here, click or tap OK.

Step :8 Finally Search in windows Remote Desktop Connections then easily connected
 

Conclusion:

After completing the above steps, users will be able to connect to your Windows computer, provided that your computer is powered on and connected to a network.
Computers running Linux, Mac OS X or Windows can connect using the Remote Desktop protocol.

If you don’t have remote tools or software related then use Remote Desktop connection on Windows. It is follow the Remote Desk protocol so it must should need Network.

Internet or Intranet is mandatory for Remote Desktop connections for all users.

Remote Desktop is secured and files are safe to access to transfer for machine is working or not.

In Windows one of the best feature in default for accessing other machines using Remote Desktop connection with LAN or Internet.

In Linux also need to install and use it very simple for accessing and transferring

 

How to Install & Remote in Any Desk

Remote one machine to another machine in simple by using Any Desk for easy to access and transfer files from any where. Any Desk using Windows , Linux and Mac operating system also supported.

How to connect one computer to another computer remotely by Any Desk follow below steps:

Step 1: First step Download Any Desk software from website





Step 2: After downloading Any Desk File and Install that file.

Similar to other remote desktop programs, like Remote Desktop software s,  Any Desk uses an ID number to make establishing a connection easy.

 

 

 

 

 

 

 

 

 

 

2) If you install Any Desk instead of just run it portable, you’ll be given an Any Desk-ID, which is created automatically and based on the name of the computer

3) (like myPC@ad) instead of on numbers.When both the host and client computer are running Any Desk, they can share the Any Desk-Address with the other

4) and enter it in the “Remote Desk” part of the program to start the connection.

Above steps are very simple to access one machine to another using Any Desk software. Any Desk same as Team viewer and Remote Desktop software but here easy to access and transferred files very simple.

Please check Any Desk is ready or not in bottom of that.

How Exit From Any Desk:




Go to Bottom task bar Right click on Any Desk then click on Quit.

 

Any Desk is used for technical support scams and identification of computers whether computer is working or not.

Any Desk uses for security purpose also to encrypt connections. Mostly used for Personal PCs, iOS and Mobile applications.

Any Desk used for multi platform support and Light weight software for all users.

Finally Any Desk is light weight and fast remote accessing and transferring files from one machine to another machine.

Now a days system admins also mostly used is Any Desk.

 

 

 

 

How to Enable .NET Frame work 3.5 Online and Offline

In Windows operating system some software are not installed due to .NET frame work enable issues related. Now a days .NET most issue in Windows so here how to enable with Internet or without Internet .

# Method 1: If Internet is Available:

Step :1 Open Control Panel –> Program and Features
Step :2 Click on Turn Windows features on or off.

To install the following window click on the .NET Framework 3.5. First select .NET icons then click on Ok

After that it will take some more time then automatically updated then restart your system.

 

# Method 2: Offline(Manually)

If you don’t have Internet and we nee some knowledge on Windows follow below simple steps

Step:1 First step copy the sxs files in your booting USB and then go to Local Disk then Windows sources folder paste into your SXS folders Paste it check below path
D:\sources\sxs(Choose Driver correctly) USB Path for copying SXS files

C:\Windows\sxs paste into sxs folder into this directory.

Step:2 After that go to windows start then type command prompt Run as administrator .




Step:3 Dism /online /enable-feature /featurename:NetFx3 /All /Source:D:\sources\sxs /LimitAccess

use above command for enabling .NET frame works simple but please check your path is correct or not

After completion of 100% then it automatically enabled .NET frame work feature into your Windows PC.

The Enabling content is done then will go with Windows features  then click on .NET Framework option and click on OK. Go to below path then update it.

Control Panel–>Program and Features

Above steps how to enable .NET frameworks in Offline after successfully completed your operating system on Windows then simple enable it.

If not install the .NET Framework some of software packages are not supported in specially in Windows operating system. To check above one step by step by process for beginners , Windows users and System admins.

How to make a Bootable USB in Windows 7&8 with Pictures




In USB booting makes with simple commands without internet. Some tools are the directly booting example: Rufus etc. But in your offline, it is useful and improves your commands in windows. First, we need Pendrive or USB without content because when will format it so data will lose at the time. Empty USB then follow below steps simply.

USB Booting with Simple commands

Step:1 Start Command with Run as Administrator

In your command Prompt with Run as Administrator for user privileges

Step 2 : Type “diskpart” in your command prompt for disk information

Here simply check with disk version and copyrights information

Step 3 : Type “list disk”

Then see above list of your disks in your PC

Step 4 :Type “select disk 1” here we take only

Check which one is your USB drive after that will select it.

Step 5 :Type “clean”

Simply clean with your USB disk only. Here erase your USB contents and create new tracks in your USB.

Step 6 :Type “create partition primary”

After clean USB then will create partition in your drive




Step 7 :Type “select partition 1”

After creation your partition in your USB then will select partition

Step 8: Type “active”

After select your USB then active command using active your USB tracks and partitions.

Step 9 : Type “format fs = fat 32 quick”

After active your USB then will format in FAT format quickly

Step 10:Type “assign”

Assign your USB

Step 11:Type “exit”

After assign your USB then exit then copy your operating system files.

After completed above steps will copy your operating system files into your USB or Pendrive. Other wise if you Internet facilities then will go with Booting tools. Be careful with when will booting because some times lose content in your USB please check then move further steps.

In Windows operating systems installation time will use this commands for beginners and admins.



Step by Step How to install Windows 7 with Pictures



Windows 7 Installation with Pictures:

Windows 7 Operating System is a most familiar one. Simple to Install software s and user-friendly for beginners. First booting your pen drive with operating system after that will follow below steps

Step1: Booting Files:

First will Turn on your PC and Press ‘F2’ button or depends upon your system. There will show some option to boot through USB or CD/DVD (Pendrive). Select that option Windows will start loading files. 

Step2: Prepare to Install Now :

After that, you will get the Windows Setup Window. This is the part for select language ‘English’ and clicks on ‘Next’ then click on ‘Install now’.



Step3Click on the Custom option 

There will be a  license agreement check on ‘I ACCEPT‘ and proceed to Next. After that two options are showing ‘Upgrade’ and ‘Custom’. Select ‘Upgrade’

Step4: Select the Drive then If you need Format the Drive:

 After that, you will do partitioning of your drive be careful, and choose a partition. If you need a new partition to click on ‘New’ button and choose them then will you create a new drive

Step5After Format Drive Select the Drive:

 After created new drive then select the drive which you want to install windows. Click on ‘Format’. It will erase all the previous data click on ‘Next’ to proceed.

Step6: Click on Next

 After clicking on Next it will loading files, Initializing files.

Step7Create Username and Password

In this step create a username and PC name as well as a set password of your PC.

Step8:  If you ask Product ID then Enter

 In case not enter starting of your installation the will ask in this step Product ID

Step 9: Click on Next:

After enter product id the will ask Network options first you will check

 

Step10: After successful completion of the above steps then open your windows 7 system.

Windows 7 latest version installation also  simple for beginners and all . Above installation steps are very carefully while installing  whether data content before the operating system or not. Check to Install it.