Software Engineer L4/L5, Model Serving Systems, Machine Learning Platform

Details of the offer

Netflix is one of the world's leading entertainment services with 278 million paid memberships in over 190 countries enjoying TV series, films and games across a wide variety of genres and languages. Members can play, pause and resume watching as much as they want, anytime, anywhere, and can change their plans at any time.

The Role
Machine Learning/Artificial Intelligence powers innovation in all areas of the business, from helping members choose the right title for them through personalization, to better understanding our audience and our content slate, to optimizing our payment processing and other revenue-focused initiatives. Building highly scalable and differentiated ML infrastructure is key to accelerating this innovation.

More recently, fast-paced innovation in large language models (LLMs) has greatly helped advance state-of-the-art technology in many areas of personalization, including search and recommendation experiences.

The Opportunity

The Model Serving Systems team provides the computational platform on which we build nearly all our consumer and studio-facing ML/AI applications. We provide all the building blocks to serve ML models at scale, including a real-time model inference and serving platform, foundational abstractions that ensure consistency between online and offline systems, and more. Additionally, as we expand to enable LLM innovation in numerous areas of personalization, we're building model serving infrastructure for LLMs and other large foundation models.

We're expanding our model serving systems to meet the evolving needs of the evolving AI landscape. ??We are looking for strong engineers to develop and expand our compute infrastructure to support the growing AI needs, enable the application of ML in new business areas, and drive ML/AI innovation across Netflix. Our systems power some of Netflix's most business-critical models, and we need you to take our ML/AI initiatives to the next level. You will play a highly cross-functional role, partnering with other engineers, product managers, machine learning engineers, and data/research scientists.

If you have a passion for building scalable, robust systems, are interested in pushing the envelope in applying ML algorithms, and operate in a critical part of the stack that strongly influences what our customers see on their screens, then we want to talk to you.

You may enjoy working with us if:

You strive to embrace best practices and are curious about discovering new and better ways to solve problems.

You are self-driven and highly motivated to deliver top-tier solutions while learning from and collaborating with Stunning Colleagues.

You are strongly motivated to pick up new domains and ship high-quality, extensible code.

You are excited to work in a multidisciplinary environment (engineering, algorithms, data engineering/science, product experimentation).

You are comfortable working in a team with peers and partners distributed across (US) geographies & time zones.

We would love to work with you if:

You have experience building high-traffic distributed services and infrastructure for online ML model inference and are familiar with supporting large-scale ML models focusing on high availability and performance.

You understand scalable model-serving solutions for generative models and LLMs, with skills in reducing latency and costs, and can solve bottlenecks to streamline research-to-production workflows.

You are proficient in object-oriented programming (preferably Java) and demonstrate engineering excellence in production hosting, including performance tuning, deployment management, and capacity planning.

You are familiar with deploying ML models using tools like Triton Inference Server, TensorRT, Docker.

You are experienced working with the public cloud like AWS, Azure, or GCP.

You are a proactive communicator who promotes best practices in observability and logging.

You have a BS/MS in Computer Science, Applied Math, Engineering, or a related field.

Our compensation structure consists solely of an annual salary; we do not have bonuses. You choose each year how much of your compensation you want in salary versus stock options. To determine your personal top-of-market compensation, we rely on market indicators and consider your specific job family, background, skills, and experience to determine your compensation in the market range. The range for this role is $100,000 - $720,000K

Netflix provides comprehensive benefits including Health Plans, Mental Health support, a 401(k) Retirement Plan with employer match, Stock Option Program, Disability Programs, Health Savings and Flexible Spending Accounts, Family-forming benefits, and Life and Serious Injury Benefits. We also offer paid leave of absence programs. Full-time hourly employees accrue 35 days annually for paid time off to be used for vacation, holidays, and sick paid time off. Full-time salaried employees are immediately entitled to flexible time off. See more details about our Benefitshere.

Netflix has a unique culture and environment. Learn morehere.

We are an equal-opportunity employer and celebrate diversity, recognizing that diversity of thought and background builds stronger teams. We approach diversity and inclusion seriously and thoughtfully. We do not discriminate on the basis of race, religion, color, ancestry, national origin, caste, sex, sexual orientation, gender, gender identity or expression, age, disability, medical condition, pregnancy, genetic makeup, marital status, or military service.

Job is open for no less than 7 days and will be removed when the position is filled.


Nominal Salary: To be agreed

Source: Eightfold_Ai

Requirements

Senior Software Engineer, Compiler

Monad Labs is the team building Monad, the performant and parallel EVM Layer-1 blockchain. We are a team of systems engineers and community builders who are ...


Monad - Oregon

Published 14 days ago

Contract, Sme, Gis Technician

Transfr is on a mission to help create pathways to career success. Our immersive career exploration and training simulations empower learners and job seekers...


Transfr - Oregon

Published 13 days ago

Sr. Consultant Application Modernization

\n \n$155,750 - $155,750 a year JOB DUTIES: Work with client and MCA Connect project teams and Solutions Architect to define functional requirements and doc...


Mca Connect - Oregon

Published 13 days ago

Senior Software Engineer

We're Gameye. We're on a mission to host the world's most demanding games flawlessly. So we've created an orchestrator that lets multiplayer developers host ...


Gameye - Oregon

Published 13 days ago

Built at: 2024-12-23T02:05:13.770Z