Hadoop Framework Developer - Data Quality

Job Title - Hadoop Framework Developer - Data Quality Location - Chicago, IL (Hybrid) Duration - 12 Months Key Responsibilities: Designing, implementing, and maintaining data quality frameworks within our Hadoop ecosystem.
You will play a crucial role in ensuring the accuracy, consistency, and reliability of large-scale data across our organization.
Designing and developing scalable data quality frameworks and tools using Hadoop technologies such as MapReduce, Hive, Pig, and Spark.
Implementing automated data quality checks and validations to ensure data integrity throughout the ETL processes.
Optimizing Hadoop jobs and data processing workflows for efficiency, reliability, and scalability.
Basic Qualifications: A minimum of 3 years of experience with Hadoop Framework A minimum of 3 years of experience with ETL Processing A minimum of 3 years of experience with Spark Associate's Degree Preferred Qualifications: Experience with Python Experience with Data Experience with Hive