The Company At Servant Digital, we specialize in empowering leaders and organizations within faith communities through innovative digital transformation and change management solutions. We are committed to providing tailored strategies that align with our clients' values and missions, focusing on service, integrity, and excellence. Our team is passionate about making a meaningful impact by equipping our partners with the tools and technologies they need to thrive in a rapidly evolving digital landscape. Join us in our mission to support those who support others.
The Role We are seeking a Data Engineer to design, build, and maintain the data pipelines and infrastructure needed to support the migration to Snowflake and our client's analytics goals. This role will focus on creating reliable, efficient ETL processes while ensuring data quality, monitoring, and governance are integrated into all workflows. The ideal candidate is a problem-solver with strong technical skills, who thrives in a collaborative environment and can adapt to evolving data needs.
Responsibilities: Pipeline Development and Migration:Develop and maintain ETL/ELT pipelines to migrate data from BigQuery to Snowflake.Work closely with the Data Architect to ensure pipelines are efficient, scalable, and aligned with business requirements.Perform rigorous testing and validation to ensure data accuracy during migration.Data Quality Assurance:Implement automated validation processes to ensure data integrity across systems.Collaborate with analysts and governance teams to monitor and address data anomalies or inconsistencies.Create workflows to ensure all ingested data adheres to predefined quality standards.Data Monitoring and Optimization:Build monitoring dashboards to track pipeline performance, error rates, and data flow in real-time.Identify bottlenecks in pipelines or queries and implement optimizations to enhance performance.Ensure pipeline reliability through proactive troubleshooting and system alerts.Snowflake Maintenance:Support Snowflake configuration, including schema design, query optimization, and cost management.Implement best practices for Snowflake security, such as role-based access control and data encryption.Regularly evaluate and optimize storage and compute costs.Collaboration and Support:Work with the Data Architect to execute the overall data strategy and roadmap.Partner with analysts to understand their data needs and deliver high-quality, ready-to-use datasets.Support ad hoc data requests, ensuring timely delivery and clear communication.Documentation:Maintain comprehensive documentation for ETL pipelines, data transformations, and monitoring processes.Contribute to organizational knowledge by sharing best practices and lessons learned. Qualifications: Bachelor's degree in Computer Science, Data Engineering, or a related field.3-5 years in data engineering, with a focus on cloud-based data platforms and pipelines.Technical Expertise:Hands-on experience with Snowflake or similar cloud data warehouses.Familiarity with BigQuery and prior experience supporting data warehouse migrations.ETL Development:Proficiency in building ETL/ELT pipelines using tools like Fivetran, Stitch, or Airflow.Strong SQL skills for query optimization and data transformation.Programming:Advanced skills in Python for scripting and workflow automation.Data Quality and Monitoring:Knowledge of data validation techniques and monitoring frameworks (e.g., Monte Carlo, Great Expectations).Experience building dashboards for monitoring pipeline health.Governance Knowledge:Familiarity with governance principles, including data lineage and access control.Soft Skills:Strong problem-solving abilities and a proactive approach to challenges.Excellent communication skills for working with technical and non-technical stakeholders.Experience working remotely. Prior consulting experience preferred. At Servant, we believe in the power of diversity and inclusion. We are an equal opportunity employer and encourage individuals from all backgrounds to apply.