10453 – Data Engineer I Purpose: We are looking for a motivated and detail-oriented Data Engineer to join our data engineering team with a strong focus on assisting in the development of workflow automation using Apache Airflow and developing data pipelines. In this role, you will work closely with data scientists, analysts, and other engineering teams to build, maintain, and optimize data pipelines and workflows that power our data-driven decision-making process.
Essential Functions: Design, build, and maintain scalable data pipelines to process and transform raw data into usable formats.Implement ETL (Extract, Transform, Load) processes to move data from various sources into data warehouses or data lakes.Integrate data from multiple sources, including databases, APIs, and external data sources.Ensure seamless data flow and integration across different systems and platforms.Create and maintain data models and schema designs that align with business requirements.Optimize database structures and design for performance and scalability.Work closely with data scientists, analysts, and business stakeholders to understand data needs and requirements.Translate business requirements into technical solutions and data structures.Develop and maintain scripts and automation tools to streamline data processing and pipeline operations.Implement automated monitoring and alerting systems for data pipelines and databases.Document data pipeline architectures, data models, and ETL processes.Create reports and visualizations to communicate data insights and pipeline performance to stakeholders.Please note this job description is not designed to cover or contain a comprehensive listing of activities, duties, or responsibilities that are required of the employee for this job. Duties, responsibilities, and activities may change at any time with or without notice.
Basic Requirements: Bachelor's degree in Computer Science, Information Technology, or related field.Basic knowledge of SQL and experience with relational databases.Strong programming and scripting skills, such as Python, Java, Scala, SQL, or similar languages used in data engineering.Knowledge of big data technologies, including Apache Spark, Hadoop, or equivalent cloud-based services.Understanding of data modeling, data integration, and data transformation concepts.Experience with data governance, data security, and data quality practices in cloud environments.Basic analytical and problem-solving skills, with the ability to optimize and troubleshoot data pipelines.Excellent communication and collaboration skills, with the ability to work effectively in a team-oriented environment.Salary range: $69,390 to $90,200
#J-18808-Ljbffr
