Sqoop UI
The Sqoop UI enables transfering data from a relational database
to Hadoop and vice versa. The UI lives uses Apache Sqoop to do this.
See the Sqoop Documentation for more details on Sqoop.
Installation and Configuration
The Sqoop UI is one of the applications installed as part of
Hue. For information about installing and configuring Hue, see the Hue Installation
manual.
Starting
Click the Sqoop icon
(
) in the navigation bar at the top of
the Hue browser page.
Sqoop Jobs
Sqoop UI is oriented around jobs in Apache Sqoop.
Creating a New Job
- Click the New job button at the top right.
- In the Name field, enter a name.
- Choose the type of job: import or export.
The proceeding form fields will change depending on which type is chosen.
- Select a connection, or create one if it does not exist.
- Fill in the rest of the fields for the job.
For importing, the "Table name", "Storage type", "Output format", and "Output directory" are necessary at a minimum.
For exporting, the "Table name" and "Input directory" are necessary at a minimum.
- Click save to finish.
Editing a Job
- In the list of jobs, click on the name of the job.
- Edit the desired form fields in the job.
Copying a Job
- In the list of jobs, click on the name of the job.
- On the left hand side of the job editor, there should be a panel containing actions.
Click Copy.
Removing a Job
- In the list of jobs, click on the name of the job.
- On the left hand side of the job editor, there should be a panel containing actions.
Click Delete.
Running a Job
There's a status on each of the items in the job list indicating
the last time a job was ran. The progress of the job should dynamically
update. There's a progress bar at the bottom of each item on the job list
as well.
- In the list of jobs, click on the name of the job.
- On the left hand side of the job editor, there should be a panel containing actions.
Click Run.
Creating a New Connection
- Click the New job button at the top right.
- At the connection field, click the link titled Add a new connection.
- Fill in the displayed fields.
- Click save to finish.
Editing a Connection
- Click the New job button at the top right.
- At the connection field, select the connection by name that should be edited.
- Click Edit.
- Edit the any of the fields.
- Click save to finish.
Removing a Connection
- Click the New job button at the top right.
- At the connection field, select the connection by name that should be deleted.
- Click Delete.
NOTE: If this does not work, it's like because a job is using that connection.
Make sure not jobs are using the connection that will be deleted.
Filtering Sqoop Jobs
The text field in the top, left corner of the Sqoop Jobs page enables fast filtering
of sqoop jobs by name.