NVIDIA Logo

NVIDIA

Senior Software Engineer, Infrastructure Automation and Distributed Systems

Posted 2 Days Ago
Be an Early Applicant
In-Office or Remote
2 Locations
224K-431K Annually
Senior level
In-Office or Remote
2 Locations
224K-431K Annually
Senior level
Design, build, deploy, and run reliable large-scale infrastructure services. Define SLOs and observability, automate toil, manage software lifecycle, participate in on-call incident response, and consult with peer teams on systems design best practices.
The summary above was generated by AI

We are seeking Systems Engineers and Software Engineers interested in building and running reliable large scale infrastructure platform services. In this organization, you will ensure that our internal and external facing EDA services atop of NVIDIA hardware are running as reliably as needed. NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hard-working people in the world working for us. Are you creative and autonomous? Do you love a challenge? If so, we want to hear from you.

What you’ll be doing:

  • Design, build, deploy, and run infrastructure services & manage the software life cycle in scope to meet our business goals.

  • Participate in the definition of our internal facing service level objectives and error budgets as part of our overall observability strategy.

  • Eliminate toil or automate it where the ROI of building and maintaining automation is worth it.

  • Practice sustainable blameless incident prevention and incident response while being a member of an oncall rotation.

  • Consult with and provide consultation for peer teams on systems design best practices.

What we need to see:

  • BS degree in Computer Science or a related technical field involving coding (e.g., physics or mathematics) or equivalent experience.

  • 12+ years of relevant experience.

  • A track record showing a good balance between initiating your own projects, convincing others to collaborate with you and collaborating well on projects initiated by others.

  • Experience with infrastructure automation and distributed systems design developing tools for running large scale private or public cloud system in production.

  • Experience in one or more of the following: Python, Go, Perl or Ruby.

  • In depth knowledge in one or more of Linux, Networking, Storage, and Containers.

Ways to stand out from the crowd:

  • Systematic problem-solving approach, coupled with strong communication skills and a sense of ownership and drive. Experience accelerating positive impact to the business using coding assistant(s), MCP servers, or AI agents.

  • Experience working with or developing bare metal as a service (BMaaS) associated systems.

  • Experience working with or developing multi-cloud infrastructure services and running private or public cloud systems based on one or more of Kubernetes, OpenStack, Docker or Slurm.

  • Experience teaching reliability (e.g SRE) or more general cloud systems good practices to peers or to other companies (e.g CRE).

  • Background with NVIDIA Collective Communication Library (NCCL).

No prior experience having worked in a team of any particular name or having worked in a ML/AI focused team are required but also a nice to have.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 224,000 USD - 356,500 USD for Level 5, and 272,000 USD - 431,250 USD for Level 6.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until June 15, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Similar Jobs

3 Hours Ago
Remote or Hybrid
77K-202K Annually
Senior level
77K-202K Annually
Senior level
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Maintain data integrity and quality through advanced testing and validation of ETL pipelines. Analyze complex data issues, build solutions, mentor junior staff, engage with clients, and support continuous improvement across data management, governance, and pipeline orchestration.
Top Skills: Apache AirflowAWSAws GlueAzureETLInformatica Data Quality (Idq)PrefectPythonQlikSnowflakeSQL
3 Hours Ago
Remote or Hybrid
Florham Park, NJ, USA
155K-410K Annually
Senior level
155K-410K Annually
Senior level
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
The IT Infrastructure Managed Services Director leads cloud and network architecture solutions, drives business growth, and mentors teams, ensuring exceptional service delivery and client satisfaction.
Top Skills: Cloud ArchitectureInfrastructure SolutionsNetwork Architecture
3 Hours Ago
Remote or Hybrid
2 Locations
151K-187K Annually
Senior level
151K-187K Annually
Senior level
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Design and improve user experiences for human-AI systems by conducting research, usability testing, creating personas and prototypes, collaborating with cross-functional teams, analyzing trends, and building client relationships to deliver human-centered design solutions.

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account