Friday, April 10, 2020

copying data from DB to HDFS, Sqoop

$ sqoop import –connect jdbc:mysql://localhost/db –username foo –table TEST

or 

$ sqoop –options-file /users/homer/work/import.txt –table TEST
where the options file /users/homer/work/import.txt contains the following:
import
–connect
jdbc:mysql://localhost/db
–username
foo

No comments:

Post a Comment

Distributed Computing: A Guide to Comparing Data Between Hive Tables Using Spark

In big data, efficient data comparison is essential for ensuring data integrity and validating data migrations. Apache Spark, with its in-me...