Senior Etl Hadoop Developer

Description:

Position requires resource to work with business team to understand data requirements and work with source systems.
Requires extracting data from source systems and loading into Hadoop (Spark).
Requires investigating and resolving data and system issues, providing support.

Proven experience in designing & building data lakes on Hadoop using the latest technologies.
Experience in building integration layers to integrate data from multiple systems to Hadoop.
Experience in architecture and solution design of analytics on Hadoop.
Experience in building pipelines to ingest data into Hadoop.
Working experience in dealing with data in multiple formats (csv, txt, xml, JSON).
10 years of experience in building DW/ETL applications.
5+ years of experience in working with Hadoop ecosystem.
Working experience with Hive, Spark, Python, and Hadoop libraries.
Experience in building data lakes in Hadoop is a must.
Experience in building ETL and data aggregations.
Experience with Sqoop, Flume, and Spark is required.
Excellent SQL knowledge is required.
Experience in extracting data from RDBMS and SAS applications using APIs.

Must have skills:

10+ years of experience in building DW/ETL applications / 5+ years of experience in working with Hadoop ecosystem / Knowledge of Hive, Spark, Python, Hadoop libraries / Experience building data lakes in Hadoop / Experience with Sqoop, Flume, Spark / Excellent SQL knowledge.

Nice to have skills:

Visualization skills, Power BI experience.

Roles and responsibilities:

Working with source systems to design, then developing ETL to load data. Troubleshoot issues and collaborate with support system partners to resolve issues.


#J-18808-Ljbffr