NVIDIA Logo

NVIDIA

Senior System Software Engineer - Data Platform Observability

Posted Yesterday
Be an Early Applicant
In-Office or Remote
Hiring Remotely in Austin, TX
184K-288K Annually
Senior level
In-Office or Remote
Hiring Remotely in Austin, TX
184K-288K Annually
Senior level
Lead design and implementation of a scalable observability and data platform: high-performance telemetry ingestion, data governance and policy enforcement, modern UX/APIs, cost-optimized tiered storage, and automation for lifecycle and pipeline orchestration. Collaborate with cross-functional teams to provide operational and strategic data for debugging, performance, and reliability.
The summary above was generated by AI

NVIDIA’s Hardware Infrastructure organization is seeking a Senior System Software Engineer to lead the evolution of our next-generation Data & Observability Platform. We serve and collaborate directly with NVIDIA’s rapidly growing AI, HW, and SW engineering and research teams across the company. We are looking for a Full-Stack technical lead who is not afraid to dig deep into infrastructure. You will be the technical anchor for our Observability stack, driving the transition to a modern tooling that is best fit for our customers and use cases. You will build the centralized platform that thousands of NVIDIA engineers rely on to visualize chip telemetry, debug distributed pipelines, and ensure platform reliability.

What you’ll be doing:

  • Architect High-Performance Ingestion: Design and build centralized telemetry pipelines capable of handling massive scale. You will solve global latency challenges by implementing modern, push-based edge collection architectures to replace legacy proxy models.

  • Build Policy Enforcement Systems: Design and implement the technical infrastructure for data governance,  policy engines, access control enforcement points,  secure credential management, and audit logging. Looking for someone who has built governance controls into a platform, not just administered them.

  • Focus on User Experience: Develop a modern, web interface and APIs  that unify distinct observability signals into a seamless, consolidated user experience.

  • Optimize Storage & Cost: Implement cost-effective tiered storage architectures. You will define strategies for routing high-volume data to cold storage solutions to reduce costs while maintaining multi-year data retention.

  • Drive Platform Automation: Architect workflow orchestration systems to automate platform maintenance, data lifecycle management, and complex pipeline operations.

  • Work in a diverse team to provide operational and strategic data to empower our engineers and researchers to improve performance, productivity, and efficiency to continuously improve quality, workloads, and processes through better observability.

What we need to see:

  • BS or MS in Computer Science, Electrical Engineering, or related field (or equivalent experience).

  • 8+ years of full-stack software development experience with a focus on Data Platforms or Infrastructure Tools.

  • Strong Full-Stack Fluency: Proficiency in high-performance backend systems programming and modern frontend web frameworks for building responsive user interfaces (Python, JS, Java, Rust, Go, React, or similar).

  • Observability Expertise: Experience with observability platforms such as Apache Spark, Elastic/Open Search, Grafana, Prometheus, and other similar open-source tools. Hands-on experience operating and extending the Grafana Ecosystem or ELK stack at scale. You understand the internals of time-series databases and inverted indexes.

  • Infrastructure-as-Code: Experience deploying complex stateful services on Kubernetes using Helm, Terraform, or Ansible.

  • Streaming & Storage: Familiarity with event streaming and modern data lake formats 

Ways to stand out from the crowd:

  • Experience writing Custom Grafana data source Plugins or backend plugins in Go.

  • Background with migrating legacy monoliths to microservices or Vector-based pipelines.

  • Experience with OpenTelemetry (OTEL) collector configuration, writing custom processors, or instrumentation SDKs.

  • Background in Data Governance, including implementation of Policy-as-Code or compliance frameworks in a regulated environment.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until August 15, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Similar Jobs

4 Minutes Ago
Remote or Hybrid
United States
Senior level
Senior level
Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Lead strategic sales for Honeywell Aerospace OEM customers, drive revenue growth, manage strategic pursuits, develop sales plans, build executive-level customer relationships, analyze market trends, collaborate cross-functionally, and provide senior leadership insights to achieve sales targets and improve performance.
2 Hours Ago
Remote or Hybrid
United States
88K-118K Annually
Senior level
88K-118K Annually
Senior level
Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Lead buy- and sell-side Quality of Earnings engagements: analyze financials, assess earnings quality, working capital, and net debt; prepare diligence reports and presentations; manage VDRs; mentor junior staff; support valuation, deal structuring, integration planning, and business development.
Top Skills: ExcelFinancial DatabasesVirtual Data Rooms
2 Hours Ago
Remote or Hybrid
United States
107K-160K Annually
Mid level
107K-160K Annually
Mid level
Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Provide controller-level advisory to skilled nursing clients: oversee financial reporting, budgeting, forecasting, KPI/benchmarking analysis, technical accounting support, operational improvement recommendations, and lead and coach client teams to improve financial stability and reporting quality.
Top Skills: PointclickcareQuickbooks OnlineSage Intacct

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account