Job Description:
Pay Range: $60hr - $65hr
Responsibilities: s a Databricks Data Engineer, Candidates will be responsible for designing, implementing, and optimizing data pipelines and workflows using Databricks and other data engineering tools.
Candidates will work closely with cross-functional teams to ensure data integrity, performance, and scalability, enabling the organization to make data-driven decisions.
Key Responsibilities: Design, develop, and maintain data pipelines and ETL processes using Databricks, Spark, and other data engineering tools.
Implement and report on business key performance indicators (KPIs) in data warehousing environments.
Utilize analytic SQL to work with traditional relational databases and distributed systems.
Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
Optimize data workflows for performance, scalability, and reliability.
Develop and maintain documentation for data engineering processes and solutions.
Ensure data quality and integrity through rigorous testing and validation.
Preferred Qualifications: 4+ years of work experience implementing and reporting on business key performance indicators in data warehousing environments.
4+ years of experience using analytic SQL, working with traditional relational databases and/or distributed systems.
3+ years of experience with programming languages such as Python and PySpark.
3+ years of experience with data orchestration/ETL tools.
2+ years of experience with Databricks/Spark and Power BI.
2+ years of experience with X12 EDI.
2+ years of experience with Azure.
Skills and Competencies: Strong understanding of data warehousing concepts and best practices.
Proficiency in SQL and experience with relational databases.
Expertise in programming languages like Python and PySpark.
Experience with data orchestration tools and ETL processes.
Familiarity with Databricks, Spark, and Power BI.
Knowledge of X12 EDI standards in healthcare domain.
Excellent problem-solving skills and attention to detail.
Strong communication and collaboration skills.