Software Engineer L5, Model Observability & Lifecycle Management, Machine Learning Platform

Details of the offer

Netflix is one of the world's leading entertainment services, with 283 million paid memberships in over 190 countries enjoying TV series, films and games across a wide variety of genres and languages. Members can play, pause and resume watching as much as they want, anytime, anywhere, and can change their plans at any time.

The Model Observability & Lifecycle Management team's centralized MLOps platform multiplies the productivity of both the Machine Learning Platform (MLP) organization and all ML practitioners across Netflix. We maintain the reliability of ML applications by building systems to catch and diagnose issues as soon as possible, sometimes before they even happen!

We're building a comprehensive and centralized system for managing ML models, featuring capabilities like visualization, observability, and performance benchmarking. Our paved path for MLOps will reduce redundancy, minimize operational overhead, and offer standardized workflows and UIs to researchers and infrastructure engineers throughout the company.

??We seek strong engineers to develop and expand our model observability and visualization workflows to support bandits, multi-task learning models, Large Language Models (LLMs), and other foundation models. Our tools and systems support and enable 100s of ML practitioners to develop some of Netflix's most business-critical models across personalization, growth and commerce, ads, and studio algorithms. You will play a highly cross-functional role, partnering with other engineers, product managers, machine learning engineers, and data/research scientists to elevate our ML/AI initiatives and drive impactful innovation.

Snapshot of projects you may work on:

Observability dashboard and corresponding backend system to integrate with various MLP products to enable ML practitioners to explore and discover ML entities (models, features, embeddings, pipelines, etc.) and monitor and operate them effectively

Model registry to catalog ML models and their versions to enable discoverability, including core model store functionality with an API backend and an SDK integration layer

Collaborate with cross-functional teams to implement anomaly and drift detection on models, features, embeddings, etc., automatically detecting and alerting on staleness and quality issues and suggesting or implementing fixes

Cost monitoring and chargeback dashboards to provide visibility into resource utilization and identify opportunities for efficiency improvements

Enhance our user interfaces to provide intuitive and seamless experiences for ML practitioners, incorporating feedback and best practices to improve usability and adoption.

We would love to work with you if:

You have experience building backend distributed systems and full-stack systems using object-oriented programming (preferably Java), web API frameworks (preferably Spring Boot), and UI frameworks like React.

You are experienced working with the public cloud like AWS, Azure, or GCP.

You have knowledge of ML model lifecycle management and MLOps best practices to support end-to-end development, deployment, and monitoring of ML models.

You proactively communicate with cross-functional teams to drive projects and promote best practices in observability and logging.

You have a BS/MS in Computer Science, Applied Math, Engineering, or a related field.

Our compensation structure consists solely of an annual salary; we do not have bonuses. You choose each year how much of your compensation you want in salary versus stock options. To determine your personal top-of-market compensation, we rely on market indicators and consider your specific job family, background, skills, and experience to determine your compensation in the market range. The range for this role is $100,000 - $720,000K

Inclusionis a Netflix value and we strive to host a meaningful interview experience for all candidates. If you want anaccommodation/adjustmentfor a disability or any other reason during the hiring process, please send a request to your recruiting partner.

We are an equal-opportunity employer and celebrate diversity, recognizing that diversitybuilds stronger teams. We approach diversity and inclusion seriously and thoughtfully. We do not discriminate on the basis of race, religion, color, ancestry, national origin, caste, sex, sexual orientation, gender, gender identity or expression, age, disability, medical condition, pregnancy, genetic makeup, marital status, or military service.

Job is open for no less than 7 days and will be removed when the position is filled.


Nominal Salary: To be agreed

Source: Eightfold_Ai

Requirements

Senior Software Engineer, Compiler

Monad Labs is the team building Monad, the performant and parallel EVM Layer-1 blockchain. We are a team of systems engineers and community builders who are ...


Monad - Oregon

Published 14 days ago

Contract, Sme, Gis Technician

Transfr is on a mission to help create pathways to career success. Our immersive career exploration and training simulations empower learners and job seekers...


Transfr - Oregon

Published 13 days ago

Sr. Consultant Application Modernization

\n \n$155,750 - $155,750 a year JOB DUTIES: Work with client and MCA Connect project teams and Solutions Architect to define functional requirements and doc...


Mca Connect - Oregon

Published 13 days ago

Senior Software Engineer

We're Gameye. We're on a mission to host the world's most demanding games flawlessly. So we've created an orchestrator that lets multiplayer developers host ...


Gameye - Oregon

Published 13 days ago

Built at: 2024-12-23T01:49:14.138Z