Job ID: 2859143 | Amazon.com Services LLC
Join the next revolution in robotics at Amazon's Frontier AI & Robotics team, where you'll work alongside world-renowned AI pioneers like Pieter Abbeel, Rocky Duan, and Peter Chen to make breakthrough foundation models run at production scale.
As a Senior Machine Learning Engineer embedded in our science team, you'll be instrumental in transforming cutting-edge research into high-performance production systems.
You'll collaborate directly with scientists to optimize large-scale transformer architectures for robotics applications, leveraging your expertise in CUDA and TensorRT to achieve unprecedented inference efficiency at Amazon scale.
In this role, you'll balance deep technical optimization work with strategic input on model architecture decisions, ensuring our innovative robotics models are designed with performance in mind from the ground up.
You'll leverage NVIDIA's acceleration stack and other compilation techniques to tackle ambitious performance targets, working at the intersection of large language models and real-world robotics applications.
Key job responsibilities Drive inference optimization strategies for large-scale foundation models using TensorRT, CUDA, and other NVIDIA toolsCollaborate closely with scientists to influence model architectures for optimal hardware utilizationDesign and implement efficient compilation pipelines for complex transformer architecturesDevelop comprehensive benchmarking frameworks to measure and optimize model performanceBuild robust monitoring solutions to ensure reliable model serving at scaleExplore and evaluate emerging optimization techniques including ONNX Runtime and other ML compilersMaintain high engineering standards through proper testing, documentation, and code review practices A day in the life Optimize transformer blocks using custom CUDA kernels and TensorRT optimization techniquesPartner with scientists to analyze model architectures and propose efficiency improvementsImplement and benchmark various optimization strategies for large-scale modelsDebug performance bottlenecks using NVIDIA profiling toolsParticipate in technical discussions about new model architectures with the science teamDesign and maintain performance monitoring systems for production deploymentPrototype new acceleration approaches using emerging compilation frameworks Amazon offers a full range of benefits that support you and eligible family members, including domestic partners and their children.
Benefits can vary by location, the number of regularly scheduled hours you work, length of employment, and job status such as seasonal or temporary employment.
The benefits that generally apply to regular, full-time employees include:
Medical, Dental, and Vision CoverageMaternity and Parental Leave OptionsPaid Time Off (PTO)401(k) PlanIf you are not sure that every qualification on the list above describes you exactly, we'd still love to hear from you!
At Amazon, we value people with unique backgrounds, experiences, and skillsets.
If you're passionate about this role and want to make an impact on a global scale, please apply!
BASIC QUALIFICATIONS- Bachelor's degree in computer science or equivalent
- 5+ years of non-internship professional software development experience
- 5+ years of programming with at least one software programming language experience
- 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Experience as a mentor, tech lead or leading an engineering team
- Strong expertise in Python, C++ and CUDA programming
- Experience with TensorRT or similar ML optimization frameworks
- Track record of optimizing ML models for production
PREFERRED QUALIFICATIONS- Expertise in NVIDIA's ML stack (cuDNN, CUDA Graph, etc.
)
- Experience with ML compilers (ONNX Runtime, TVM, etc.
)
- Experience with transformer model optimization
- Background in performance profiling and optimization
- Experience working directly with research teams
- Track record of building robust monitoring systems
- Experience with large-scale ML serving systems
Amazon is committed to a diverse and inclusive workplace.
Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers.
If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit this link for more information.
Posted: December 6, 2024
#J-18808-Ljbffr