The Data Analytics and Insights team is seeking an experienced and talented Senior Data Engineer to join our growing team of analytics experts.
As a key member of our team, you will play an essential role in the design, development, and maintenance of data pipelines, analytic products, which includes data applications, reports, and dashboards.
We are looking for a proactive, detail-oriented, and motivated individual who can thrive in a fast-paced environment and help us scale our analytic product development to meet our clients' ever-evolving needs.
The data engineer will collaborate with our cross functional team including solution architects, data pipeline engineers, data analysts, and data scientists on mission critical initiatives and will ensure optimal delivery of analytic products.
You will have a unique opportunity to be at the forefront of the utility industry and gain a comprehensive view of the nations most advanced smart grid.
It is the perfect role for someone who would like to continue to build upon their professional experience and help advance PG&Es sustainability goals.
Work closely with Subject Matter Experts (SMEs) to design and develop data model, data pipelines and front end applications.
Implement data transformations to derive new datasets or create ontology objects necessary for business applications.
Monitor and debug critical issues such as data staleness or data quality
Improve on performance of data pipelines (latency, resource usage)
Implement operational applications
Maintain applications as usage grows and requirements change.
Act as scrum delivery team member where applicable, work in collaboration with other Data Engineers / Scientists as needed.
Help the Product Development Lead Data Analyst / Scientist to design data pipelines and user Interface applications as needed.
Contribute to creating and maintaining the project backlog in JIRA to design and develop against agreed upon scope by Technical Lead and Product Manager (as applicable).
Participate in design and specifications, algorithm, data modeling design and the associated research/analysis work and interviewing of SMEs where necessary.
Develop data pipelines using PySpark to create datasets, Foundry objects, and User Interface applications primarily within the Foundry data mgt & development platform.
Perform data validations and analysis, use PyTest to create and implement unit test for one time or automated test embedded within a pipeline.
Implement Foundry Expectations within Foundry Health checks to implement automated validations for build freshness, data freshness, primary key, schema check, but also more complex data validation that should require a build to be aborted or a warning notification.
Manage your user stories or Tasks in JIRA, split them as needed, document acceptance criteria and progress as needed to provide transparency and enable collaboration.
Work and deliver against select user stories/tasks following the AKM Product Development lifecycle.
Help with bug fixes and enhancement requests.
Join team ceremonies including daily standup, Kanban/Sprint planning, Demos.
Follow development using an agile approach to focus on business value.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day.
We are an equal opportunity/affirmative action employer that believes everyone matters.
Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances.
If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to ****** .
To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .
Required Skills & Experience
Bachelor's Degree in Computer Science, Engineering, or a related field.
4 years of experience as a data engineer or in a similar role
Hands-on experience with building data pipelines from ingestion to final object delivery.
Experience with developing analytic applications, reports, or dashboards
Experience in using no- and low-code tools for developing analytic applications
Strong SQL skills and experience working with large datasets and complex data structures.
Complete proficiency in Python and or Pyspark
Experience in Typescript (preferred) or Javascript
Excellent problem-solving and analytical skills with a strong attention to detail.
Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching.
Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.