Senior Etl Hadoop Developer

Description:

Position requires resource to work with business team to understand data requirements and work with source systems.
Requires extracting data from source systems and loading into Hadoop (Spark).
Requires investigating and resolving data and system issues, providing support.

Proven experience in designing & building data lake on Hadoop using latest technologies.
Experience in building integration layer to integrate data from multiple systems to Hadoop.
Experience in architecture and solution design of analytics on Hadoop.
Experience in building pipeline to ingest data into Hadoop.
Working experience in dealing with data in multiple formats (csv, txt, xml, JSON).
10 years of experience in building DW/ETL applications.
5+ years of experience in working with Hadoop ecosystem.
Working experience with Hive, Spark, Python, Hadoop libraries.
Experience in building data lake in Hadoop is a must.
Experience in building ETL and data aggregations.
Experience with Sqoop, Flume, Spark is required.
Excellent SQL knowledge is required.
Experience in extracting data from RDBMS, SAS applications using APIs.

Must have skills:

10+ years experience in building DW/ETL applications / 5+ years experience in working with Hadoop ecosystem / Knowledge of Hive, Spark, Python, Hadoop libraries / Experience building data lake in Hadoop / Experience with Sqoop, Flume, Spark / Excellent SQL knowledge.

Nice to have skills:

Visualization skills, Power BI experience.

Roles and responsibilities:

Working with source systems to design, then developing ETL to load data. Troubleshoot issues and collaborate with support system partners to resolve issues.

#J-18808-Ljbffr