Your Role
The Data Engineering development team Is responsible for design, development, test and deployment of large enterprise data warehouse/BI data solutions using both on-prem and cloud technologies . The Data Engineer (Consultant) will report to the Manager, Data Engineering Development. In this role you will be responsible for design, development, and implementation of data integration, data warehouse and data mart (ELT/ETL) solutions using on-prem as well as Cloud technologies.
Your Work
In this role, you will:
Building data pipelines: Create, maintain, and optimize workloads from development to production for specific use cases
Responsible for using innovative and modern tools, techniques and architectures listed below to drive automation of most-common, repeatable data preparation and integration tasks with goal of minimizing reducing defects and improving productivity
Develop and enforce data integration and data quality standards across all development initiatives according to the organization's Enterprise information services policies as well as best practices
Assist in renovating our data management infrastructure with quality of data preparation, integration and AI-enabled metadata management tools and techniques
Tracking data consumption patterns most used and valued to our customers by performing intelligent sampling and monitoring
Triage data issues, analyzing end to end data pipelines and in working with business users in troubleshooting/resolving data pipeline issues
Execute and oversee the analysis and remediation of root causes, including deficiencies in technology, process, or resource capabilities
Work in agile/DevSecOps pod model alongside solution leads, data modelers, analysts, business partners and other developers in delivery of data
Mentor junior data engineers/developer
Your Knowledge and Experience
Requires a bachelor's degree or equivalent experience
Requires at least 7 years of prior relevant experience
Hands on experience with programming languages including SQL, PL/SQL, Python on cloud data platforms like Snowflake, Oracle, SQL Server and Netezza
Strong technical understanding of data modeling (data vault 2.0), data mining, master data management, data integration, data architecture, data virtualization, data warehousing and data quality techniques with hands on experience using data management technologies like Informatica PowerCenter/IICS, Collibra, Master Data Management, DBT Cloud, Denodo and Golden Gate
Working knowledge of Git repositories (bitbucket, GitHub), CI/CD (Jenkins, Azure DevOps)and software development tools, including incident tracking, version control, release management, subversion change management(Atlassian toolset – Jira/Confluence), testing tools and systems and scheduling software (Tidal, Control-m)
Experience working with popular data discovery, analytics and BI software tools like Tableau, Qlik, PowerBI and others for semantic-layer-based data discovery
Experienced in popular open-source and commercial data science platforms such as Python, R, KNIME, Alteryx, others is a strong plus but not required/compulsory
Experience in working with data governance and data security and specifically information stewards and privacy and security officers in moving data pipelines into production with appropriate data quality, governance and security standards and certification
Adept in agile methodologies and capable of applying DevOps and increasingly Data Operations principles to data pipelines to improve the communication, integration, reuse and automation of data flows between data managers and consumers across an organization
Pay Range
The pay range for this role is: $ 118800.00 to $ 178200.00 for California.
Note
Please note that this range represents the pay range for this and many other positions at Blue Shield that fall into this pay grade. Blue Shield salaries are based on a variety of factors, including the candidate's experience, location (California, Bay area, or outside California), and current employee salaries for similar roles.
#LI-EB1