Flume and Sqoop for Ingesting Big Data
These hold/produce data to data stores like HDFS, HBase and Hive. Both the tools have default functionality and have the ability of abstracting away the users from the complication of transferring data among these systems.
Self-Paced
Learning Style
Course
Learning Style
Intermediate
Difficulty
2 Hours
Course Duration
Course Info
Certificate
{{startDate}}
9:00 AM - 5:00 PM CST
Duration - 0 Days -
About Individual Course: On Sale!
Now Only
$10.00
Regular Price
$49.00
Now Only
$10.00
Regular Price
$49.00
/ Each5 Learners Have Enrolled For This Course | ||||
When you subscribe, you get:
Learn Subscription plan gives you access to this course and over 840 other popular courses On Sale!
Now Only
$39.99
Regular Price
$44.99
Now Only
$39.99
Regular Price
$44.99
/ Month Team Pricing
5 Learners Have Enrolled For This Course |
You have already taken demo for this course.
If you want to get access to demo again, feel free to contact our support at (855) 800-8240
These hold/produce data to data stores like HDFS, HBase and Hive. Both the tools have default functionality and have the ability of abstracting away the users from the complication of transferring data among these systems.
Course Information
About this course:
Import data: Flume and Sqoop have a crucial part to play in the Hadoop ecosystem. They have the responsibility of transferring the data from sources like local file systems, HTTP, MySQL and Twitter. These hold/produce data to data stores like HDFS, HBase and Hive. Both the tools have default functionality and have the ability of abstracting away the users from the complication of transferring data among these systems.
Flume: Flume Agents have the ability to transfer data created by a streaming application to data stores like HDFS and HBase.
Sqoop: Sqoop can be used to bulk import data from typical RDBMS to Hadoop storage structures like HDFS or Hive.
Learning Objectives:
Practical application for the various sources and data stores:
- Sources: Twitter, MySQL, Spooling Directory, HTTP
- Data stores: HDFS, HBase, Hive
Flume components:
- Flume Agents
- Flume Events
- Event bucketing
- Channel selectors
- Interceptors
Sqoop components:
- Sqoop import from MySQL
- Incremental imports using Sqoop Jobs
Audience:
This course will be highly useful for those engineers who have the responsibility designing an application with HDFS/HBase/Hive as the data store. This will also be suitable for those engineers who intend to port data from legacy data stores to HDFS.
Requirements:
The course has a mandatory requirement of having knowledge of HDFS. You should also be having fundamental understanding of HBase and Hive shells, as HBase and Hive examples require that. Additionally, you should also be having a working installation of HDFS, because it is required to run majority of the examples.
Outline
More Information
| Subjects | Big Data |
|---|---|
| Lab Access | No |
| Learning Style | Self-Paced Learning |
| Learning Type | Course |
| Difficulty | Intermediate |
| Course Duration | 2 Hours |
| Language | English |
| VPA Discount | VPA Discount |
Reviews
Write Your Own Review
Course Expert:
Tom Robertson
(Data Science Enthusiast)
Tom Robertson is a Python-based data scientist with domain knowledge in behavioral neuroscience research and non-profit development. He is currently employeed as Data Science Instructor at QuickStart Technologies. Tom is inspired by the belief that data science can improve quality of life by providing our researchers, doctors and policy-makers with new, data-driven insights.
Tom has expertise on Python, SQL, and Spark. He has worked on several libraries including but not limited to Scikit-learn, Pandas, NumPy, Matplotlib, Seaborn, SciPy, NLTK, Keras, and Tensorflow.
