Software Engineer, Analytics Platform

Software Engineer, Analytics Platform | OpenAI
Location: San Francisco, CA or Remote within the US
About the Team The Research Platform Analytics team designs, builds, and operates the critical foundational data and analytics infrastructure that enables research at OpenAI. Our goal is to accelerate the progress of research towards AGI by owning critical components of the research training stack.
About the Role We seek a pragmatic and passionate engineer with a strong focus on the experience for both engineers and scientists working with large datasets. Responsibilities include ensuring robust data processing pipelines, effective observability systems, and various data lifecycle management projects centered around efficiency, security, and scale.
You will work with scaling Kubernetes services, debugging Kafka consumer lag, diagnosing distributed systems failures, and developing end-to-end data processing pipelines.
In this role, you will: Participate in architecture and engineering decisions, leveraging your experience and knowledge.Ensure the security, integrity, and compliance of data according to industry and company standards.Ensure our analytics and data platforms can scale reliably.Empower fellow engineers and researchers with excellent data tooling and systems.Collaborate with product engineers and other teams to build technical foundations.Participate in an on-call rotation to respond to critical incidents.You might thrive in this role if you have: Experience in building stream and batch data processing pipelines (e.g., Kafka, Spark, Flink).Proficiency with infrastructure management tools (Kubernetes, Terraform).A passion for observability systems, particularly for ML training.Experience with data transformation during pre-training in a ML training organization.Proficiency in Python and experience with large monorepo codebases.Experience in data lifecycle management for large organizations.Comfort operating in a fast-paced environment.About OpenAI OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We value diverse perspectives and experiences.
We are an equal opportunity employer and do not discriminate based on legally protected statuses.
Compensation: $295K – $440K + Offers Equity

#J-18808-Ljbffr