Netflix Logo

Netflix

Software Engineer 5 - Offline Inference, Machine Learning Platform

Reposted Yesterday
Remote
Hiring Remotely in USA
466K-750K Annually
Senior level
Remote
Hiring Remotely in USA
466K-750K Annually
Senior level
Design and build systems for large-scale batch inference workloads, create developer-friendly APIs, and ensure reliability and cost control in ML infrastructure.
The summary above was generated by AI

At Netflix, our mission is to entertain the world. Together, we are writing the next episode - pushing the boundaries of storytelling, global fandom and making the unimaginable a reality. We are a dream team obsessed with the uncomfortable excitement of discovering what happens when you merge creativity, intuition and cutting-edge technology. Come be a part of what’s next.

Machine Learning (ML) is core to that experience. From personalizing the home page to optimizing studio operations and powering new types of content, ML helps us entertain the world faster and better.

The Machine Learning Platform (MLP) organization builds the scalable, reliable infrastructure that accelerates every ML practitioner at Netflix. Within MLP, the Offline Inference team owns the batch-prediction layer—enabling practitioners to generate, store, and serve predictions for various models, including LLMs, computer-vision systems, and other foundation models. One of our most critical customer groups today is the content and studio ML practitioners in the company, whose work influences what we create and how we produce movies and shows you see when you log into the Netflix app. 

The Opportunity

We’re looking for a talented Software Engineer to join the newly formed Offline Inference team. You will design, build, and operate next-generation systems that run large-scale batch inference workloads—from minutes to multi-day jobs—while delivering a friction-free, self-service experience for ML practitioners across Netflix. Success in this role means not only building robust distributed systems, but also deeply understanding the ML development lifecycle to build platforms that truly accelerate our users.

What You’ll Do
  • Build developer-friendly APIs, SDKs, and CLIs that let researchers and engineers—experts and non-experts alike—submit and manage batch inference jobs with minimal effort, particularly in the domain of content and media

  • Design, implement, and operate distributed services that package, schedule, execute, and monitor batch inference workflows at massive scale.

  • Instrument the platform for reliability, debuggability, observability, and cost control; define SLOs and share an equitable on-call rotation

  • Foster a culture of engineering excellence through design reviews, mentorship, and candid, constructive feedback

Minimum Qualifications
  • Hands-on experience with ML engineering or production systems involving training or inference of deep-learning models.

  • Proven track record of operating scalable infrastructure for ML workloads (batch or online).

  • Proficiency in one or more modern backend languages (e.g. Python, Java, Scala).

  • Production experience with containerization & orchestration (Docker, Kubernetes, ECS, etc.) and at least one major cloud provider (AWS preferred).

  • Comfortable with ambiguity and working across multiple layers of the tech stack to execute on both 0-to-1 and 1-to-100 projects

  • Commitment to operational best practices—observability, logging, incident response, and on-call excellence.

  • Excellent written and verbal communication skills; effective collaboration across distributed teams and time zones.

  • Comfortable working in a team with peers and partners distributed across (US) geographies & time zones.

Preferred Qualifications
  • Deep understanding of real-world ML development workflows and close partnership with ML researchers or modeling engineers.

  • Familiarity with cloud-based AI/ML services (e.g., SageMaker, Bedrock, Databricks, OpenAI, Vertex) or open-source stacks (Ray, Kubeflow, MLflow).

  • Experience optimizing inference for large language models, computer-vision pipelines, or other foundation models (e.g., FSDP, tensor/pipeline parallelism, quantization, distillation).

  • Open-source contributions, patents, or public speaking/blogging on ML-infrastructure topics.


Generally, our compensation structure consists solely of an annual salary; we do not have bonuses. You choose each year how much of your compensation you want in salary versus stock options. To determine your personal top of market compensation, we rely on market indicators and consider your specific job family, background, skills, and experience to determine your compensation in the market range. The range for this role is $466,000.00 - $750,000.00. This compensation range will vary based on location.

Netflix provides comprehensive benefits including Health Plans, Mental Health support, a 401(k) Retirement Plan with employer match, Stock Option Program, Disability Programs, Health Savings and Flexible Spending Accounts, Family-forming benefits, and Life and Serious Injury Benefits. We also offer paid leave of absence programs. Full-time hourly employees accrue 35 days annually for paid time off to be used for vacation, holidays, and sick paid time off. Full-time salaried employees are immediately entitled to flexible time off. See more details about our Benefits here.

Netflix is a unique culture and environment. Learn more here.

Inclusion is a Netflix value and we strive to host a meaningful interview experience for all candidates. If you want an accommodation/adjustment for a disability or any other reason during the hiring process, please send a request to your recruiting partner.

We are an equal-opportunity employer and celebrate diversity, recognizing that diversity builds stronger teams. We approach diversity and inclusion seriously and thoughtfully. We do not discriminate on the basis of race, religion, color, ancestry, national origin, caste, sex, sexual orientation, gender, gender identity or expression, age, disability, medical condition, pregnancy, genetic makeup, marital status, or military service.

Job is open for no less than 7 days and will be removed when the position is filled.

Top Skills

AWS
Bedrock
Databricks
Docker
Java
Kubeflow
Kubernetes
Mlflow
Openai
Python
Ray
Sagemaker
Scala
Vertex

Netflix New York, New York, USA Office

245 W 17th St, New York, NY, United States, 10011

Similar Jobs

8 Minutes Ago
Remote or Hybrid
Detroit, MI, USA
30-30 Hourly
Internship
30-30 Hourly
Internship
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Big Data Analytics • Automation
Support design and development of onboarding, product, technical, and professional learning. Assist with needs analysis, instructional design (ADDIE), content creation (eLearning, ILT/vILT, videos), basic program evaluation, facilitation support, and project coordination under senior guidance.
Top Skills: Articulate Rise,Articulate Storyline,Canva,Vyond,Camtasia,Adobe Creative Cloud,Lms,Asana,Trello,Jira,Monday
2 Hours Ago
Remote or Hybrid
5 Locations
37K-66K Hourly
Senior level
37K-66K Hourly
Senior level
Fintech • Financial Services
Acquire and deepen relationships with affluent consumers and small businesses, advise on banking, credit, mortgage, retirement, and investment options, coordinate with specialized partners, manage compliance and risk, resolve complex customer issues, and meet licensing and regulatory requirements for SAFE and FINRA registrations.
2 Hours Ago
Remote or Hybrid
7 Locations
37K-66K Hourly
Senior level
37K-66K Hourly
Senior level
Fintech • Financial Services
The Senior Branch Premier Banker acquires affluent customers, provides financial advice, manages client relationships, and ensures compliance with banking regulations.

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account