Apache Sqoop: Sqoop is one of the import/export large data from HDFS to RDBMS and RDBMS to HDFS vice versa.
Talend: Talend is an open-source ETL Tool to provide Data Integration and Big Data environment and Cloud storage based Tool. Nowadays most popular for Data Integration and Big Data.
While running the Talend jobs in the Hadoop cluster environment getting Sqoop connection error like below.
Caused by: java.sql.SQLRecoverableException: IO Error: Connection reset at oracle.jdbc.driver.T4Cconnection.login(T4CConnection.java.498) at.oracle.jdbc.driver.PhyscicalConnection.<init>(PhysicalConnection.java:553) at.oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:528) at.java.sql.DriverManager.getConnection(DriverMAnager.java:571) at org.apache.sqoop.mapreduce.db.DBConfiguration.getConnection(DBConfiguration.java:302) ... 46 more Caused by: java.net.SocketException:Connection reset at java.net.SocketInputStream.read(SocketInputStream.java.196)
The above issue belongs to the connection (network) issue between Integration tools and Database Management System.
Resolution 1:
Step 1: We use Java Database Connectivity JDBC driver. Step 2: Then configure DNS on both systems Step 3: Restart the DB and Tools in the Hadoop cluster.
Resolution: 2
Step 1: $JAVA_HOME/jre/lib/security/java.security Step 2: securerandom.source=file:/dev/urandom
After completion of all steps then restart the Apache Sqoop.