NVIDIA Logo

NVIDIA

Lead Senior Software Engineer, Agentic AI Applications

Posted 2 Days Ago
Be an Early Applicant
In-Office or Remote
Hiring Remotely in Austin, TX
184K-357K Annually
Senior level
In-Office or Remote
Hiring Remotely in Austin, TX
184K-357K Annually
Senior level
This role involves leading the design and delivery of agentic AI applications, mentoring teams, optimizing performance, and establishing engineering standards.
The summary above was generated by AI

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by great technology—and amazing people. Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brain of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent. As an NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is inspired to do their best work. Come join the team and see how you can make a lasting impact on the world.

NVIDIA is seeking a Senior Software Engineer to serve as a Tech Lead, driving the design and delivery of agentic blueprints and reference workflows, including the AI-Q Deep Researcher blueprint. This role focuses on crafting industry-leading agentic reference examples that demonstrate how enterprises can implement agentic AI at scale. The ideal candidate is an experienced technical leader with deep expertise in generative AI, distributed systems, and ability to convert proof-of-concept applications into products. You should be comfortable translating research and prototypes into robust, scalable, and maintainable systems while mentoring others to do the same.

What you'll be doing:

  • Design, develop, and implement agentic AI blueprints (applications) that show enterprises how to utilize and deploy this technology.

  • Lead technical reviews and provide mentorship, guiding the engineering team in building production-grade workflows and extending core GenAI SDK capabilities.

  • Develop proof-of-concept workflows rooted in first principles that apply modern data science techniques to GenAI use cases.

  • Collaborate cross-functionally with product, research, and infrastructure teams to evolve NVIDIA's agentic ecosystem, including integrations between the NeMo Agent Toolkit and other NVIDIA products and services such as the NeMo Framework, NIMs, and NVIDIA Blueprints.

  • Drive performance optimization for agentic applications across the data center, focusing on improving accuracy, reducing latency, and growing efficiency.

  • Establish engineering standards and best practices for developing, testing, and deploying agentic AI applications across distributed environments.

What we need to see:

  • BS in Computer Engineering, Computer Science, Data Science, or a related field, or equivalent experience; MS or PhD preferred

  • 8+ years of software engineering experience, including 2+ years as tech lead.

  • Proficient in Python, with at least 6+ years of experience building Python libraries or applications for enterprise customers.

  • Experience with GenAI application development using LLM frameworks (e.g., Langchain, Llamaindex, or AutoGen), evaluation systems (e.g., RAGAs), and observability platforms (e.g., Arize Phoenix, W&B Weave, or LangSmith).

  • Experience using and understanding of agentic frameworks.

  • Proficient in distributed orchestration and communication frameworks (e.g., Kafka, Ray).

  • Ability to quickly learn and apply new technologies and libraries.

  • Self-starter with a proactive work ethic, capable of working independently and successfully within a distributed team.

  • Excellent communication and collaboration skills across distributed, cross-functional teams.

Ways to stand out from the crowd:

  • Demonstrated leadership in building and scaling agentic AI applications in production.

  • Experience developing your own agents in Python or a similar language (e.g., Go).

  • Concrete examples/code of how you have profiled code in the past to identify performance bottlenecks and examples of how you mitigated these.

  • Experience developing for GPU platforms and familiarity with NVIDIA technologies (e.g., CUDA, TensorRT, Triton, NeMo) and LLM serving frameworks (e.g., Dynamo, vLLM, SGLang).

  • Experience with RAG systems and communication protocols (e.g., MCP, A2A).

With competitive salaries and a generous benefits package, NVIDIA is widely considered to be one of the technology industry's most desirable employers. We have some of the most forward-thinking and versatile people in the world working with us, and our engineering teams are growing fast in some of the most impactful fields of our generation: Deep Learning, Artificial Intelligence, and Autonomous Vehicles. If you're a creative engineer who enjoys autonomy and shares our passion for technology, we want to hear from you.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until April 12, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Top Skills

Arize Phoenix
Autogen
Cuda
Dynamo
Kafka
Langchain
Langsmith
Llamaindex
Nemo
Python
Ragas
Ray
Sglang
Tensorrt
Triton
Vllm
W&B Weave

Similar Jobs

An Hour Ago
Remote
United States
Senior level
Senior level
Agency • Digital Media • eCommerce • Professional Services • Software • Analytics • Consulting
The Program Manager will drive a portfolio of digital projects, lead team operations, manage project planning and reporting standards, and ensure strong collaboration across departments and stakeholders while promoting information security best practices.
Top Skills: AIAnalyticsClarityCloudDataDigital EngineeringJIRAProject Management Tools
An Hour Ago
Remote
US
150K-185K Annually
Senior level
150K-185K Annually
Senior level
Artificial Intelligence • Healthtech • Mobile • Software • Telehealth • Generative AI
The RVP of Sales will drive business growth for Pager Health by selling AI-enabled healthcare solutions, managing complex sales cycles, leading contract negotiations, and representing the company at industry events.
Top Skills: AICrm ToolsSalesforce
An Hour Ago
Easy Apply
Remote or Hybrid
US
Easy Apply
Internship
Internship
AdTech • Enterprise Web • Information Technology • Machine Learning • Marketing Tech • Sales
As a Communications Intern at OpenX, you will write and edit content, monitor media trends, and collaborate across teams to improve communications and storytelling.
Top Skills: Google DocsGoogle SheetsGoogle Slides

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account