Big Data Analyst -using Sqoop and Advance Hive (CCA159)

About Big Data Analyst -using Sqoop and Advance Hive (CCA159)

You will start by learning what is Hadoop & Hadoop distributed file system and most common hadoop commands required to work with

Hadoop File system

Then you will be introduced to

Sqoop Import

Understand lifecycle of sqoop command.

Use sqoop import command to migrate data from Mysql to HDFS.

Use sqoop import command to migrate data from Mysql to Hive.

Use various file formats, compressions, file delimeter,where clause and queries while importing the data.

Understand split-by and boundary queries.

Use incremental mode to migrate the data from Mysql to HDFS. Further, you will learn

Sqoop Export

to migrate data.

What is sqoop export

Using sqoop export, migrate data from HDFS to Mysql.

Using sqoop export, migrate data from Hive to Mysql. Finally, we will start with

Apache Hive [Advance]

Hive Intro

External & Managed Tables

Insert & Multi Insert

Data Types & Complex Data Types

Collection Function

Conditional Function

Hive String Functions

Hive Date Functions

Mathematical Function

Hive Analysis

Alter Command

Joins, Multi Joins & Map Joins

Working with Different Files - Parquet,Avro

Compressions

Partitioning

Bucketing

Views

Lateral Views/Explode

Windowing Functions - Rank/Dense Rank/lead/lag/min/max

Window Specification