Error while running Sqoop jobs in Hadoop Cluster





Apache Sqoop: Sqoop is one of the import/export large data from HDFS to RDBMS and RDBMS to HDFS vice versa.
Talend: Talend is an open-source ETL Tool to provide Data Integration and Big Data environment and Cloud storage based Tool. Nowadays most popular for Data Integration and Big Data.
While running the Talend jobs in the Hadoop cluster environment getting Sqoop connection error like below.

Caused by:  java.sql.SQLRecoverableException: IO Error: Connection reset
at oracle.jdbc.driver.T4Cconnection.login(T4CConnection.java.498)
at.oracle.jdbc.driver.PhyscicalConnection.<init>(PhysicalConnection.java:553)
at.oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:528)
at.java.sql.DriverManager.getConnection(DriverMAnager.java:571)
at org.apache.sqoop.mapreduce.db.DBConfiguration.getConnection(DBConfiguration.java:302)
... 46 more
Caused by: java.net.SocketException:Connection reset
at java.net.SocketInputStream.read(SocketInputStream.java.196)

The above issue belongs to the connection (network) issue between Integration tools and Database Management System.

Resolution 1:

Step 1: We use Java Database Connectivity JDBC driver.
Step 2: Then configure DNS on both systems 
Step 3: Restart the DB and Tools in the Hadoop cluster.

Resolution: 2

Step 1: $JAVA_HOME/jre/lib/security/java.security
Step 2: securerandom.source=file:/dev/urandom

After completion of all steps then restart the Apache Sqoop.

Leave a Reply

Your email address will not be published. Required fields are marked *