NVIDIA Logo

NVIDIA

Senior System Software Engineer - Data Platform Observability

Reposted 11 Days Ago
In-Office or Remote
2 Locations
184K-288K Annually
Senior level
In-Office or Remote
2 Locations
184K-288K Annually
Senior level
Lead design and implementation of a scalable observability and data platform: build high-performance ingestion, governance and policy systems, unified web APIs/UX, tiered storage, and automation for lifecycle and pipeline orchestration to support NVIDIA engineers at scale.
The summary above was generated by AI

NVIDIA’s Hardware Infrastructure organization is seeking a Senior System Software Engineer to lead the evolution of our next-generation Data & Observability Platform. We serve and collaborate directly with NVIDIA’s rapidly growing AI, HW, and SW engineering and research teams across the company. We are looking for a Full-Stack technical lead who is not afraid to dig deep into infrastructure. You will be the technical anchor for our Observability stack, driving the transition to a modern tooling that is best fit for our customers and use cases. You will build the centralized platform that thousands of NVIDIA engineers rely on to visualize chip telemetry, debug distributed pipelines, and ensure platform reliability.

What you’ll be doing:

  • Architect High-Performance Ingestion: Design and build centralized telemetry pipelines capable of handling massive scale. You will solve global latency challenges by implementing modern, push-based edge collection architectures to replace legacy proxy models.

  • Build Policy Enforcement Systems: Design and implement the technical infrastructure for data governance,  policy engines, access control enforcement points,  secure credential management, and audit logging. Looking for someone who has built governance controls into a platform, not just administered them.

  • Focus on User Experience: Develop a modern, web interface and APIs  that unify distinct observability signals into a seamless, consolidated user experience.

  • Optimize Storage & Cost: Implement cost-effective tiered storage architectures. You will define strategies for routing high-volume data to cold storage solutions to reduce costs while maintaining multi-year data retention.

  • Drive Platform Automation: Architect workflow orchestration systems to automate platform maintenance, data lifecycle management, and complex pipeline operations.

  • Work in a diverse team to provide operational and strategic data to empower our engineers and researchers to improve performance, productivity, and efficiency to continuously improve quality, workloads, and processes through better observability.

What we need to see:

  • BS or MS in Computer Science, Electrical Engineering, or related field (or equivalent experience).

  • 8+ years of full-stack software development experience with a focus on Data Platforms or Infrastructure Tools.

  • Strong Full-Stack Fluency: Proficiency in high-performance backend systems programming and modern frontend web frameworks for building responsive user interfaces (Python, JS, Java, Rust, Go, React, or similar).

  • Observability Expertise: Experience with observability platforms such as Apache Spark, Elastic/Open Search, Grafana, Prometheus, and other similar open-source tools. Hands-on experience operating and extending the Grafana Ecosystem or ELK stack at scale. You understand the internals of time-series databases and inverted indexes.

  • Infrastructure-as-Code: Experience deploying complex stateful services on Kubernetes using Helm, Terraform, or Ansible.

  • Streaming & Storage: Familiarity with event streaming and modern data lake formats 

Ways to stand out from the crowd:

  • Experience writing Custom Grafana data source Plugins or backend plugins in Go.

  • Background with migrating legacy monoliths to microservices or Vector-based pipelines.

  • Experience with OpenTelemetry (OTEL) collector configuration, writing custom processors, or instrumentation SDKs.

  • Background in Data Governance, including implementation of Policy-as-Code or compliance frameworks in a regulated environment.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until March 1, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Top Skills

Ansible
Spark
Data Lake Formats
Elasticsearch
Elk
Event Streaming
Go
Grafana
Helm
Java
JavaScript
Kubernetes
Opensearch
Opentelemetry
Prometheus
Python
React
Rust
Terraform
Time-Series Databases
Vector

Similar Jobs

13 Minutes Ago
Remote or Hybrid
United States
Entry level
Entry level
Fintech • Machine Learning • Software • Financial Services
This position is an opportunity to fill a form for future job matching after the ASPLOS Conference with IMC Trading.
28 Minutes Ago
Remote or Hybrid
USA
85K-120K Annually
Senior level
85K-120K Annually
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Conduct research on mobile threats, analyze cyber campaigns, reverse engineer malware, produce intelligence reports, and collaborate with teams for threat detection.
Top Skills: DebuggersDecompilersDisassemblersMalware AnalysisPythonReverse Engineering
28 Minutes Ago
Remote or Hybrid
USA
125K-180K Annually
Mid level
125K-180K Annually
Mid level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
The ISSO will enhance security and compliance for federal cloud environments, manage ATO processes, conduct audits, and oversee incident responses.
Top Skills: Aws GovcloudCC++Ci/CdEndpoint SecurityFedrampFismaJavaScriptNist Sp 800-53PythonRmfSIEM

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account