The Lead AI Engineer will design and implement LLM-powered applications, optimize RAG pipelines, and evaluate models while integrating AI systems into production environments.
ZS is a place where passion changes lives. As a management consulting and technology firm focused on improving life and how we live it, we transform ideas into impact by bringing together data, science, technology and human ingenuity to deliver better outcomes for all. Here you'll work side-by-side with a powerful collective of thinkers and experts shaping life-changing solutions for patients, caregivers and consumers, worldwide. ZSers drive impact by bringing a client-first mentality to each and every engagement. We partner collaboratively with our clients to develop custom solutions and technology products that create value and deliver company results across critical areas of their business. Bring your curiosity for learning, bold ideas, courage and passion to drive life-changing impact to ZS.
What you'll do: Lead AI Engineer in the Platforms and Products will...
We are seeking a highly motivated Applied AI Engineer with a strong foundation in Machine Learning and a deep interest in Large Language Models (LLMs) and Generative AI. This role focuses on building, optimizing, and evaluating production-grade LLM systems, including Retrieval-Augmented Generation (RAG), fine-tuning workflows, and scalable inference pipelines.
What you'll bring:
How you'll grow:
Perks & Benefits:
At ZS, your growth matters. We offer a comprehensive total rewards package that supports your health and well-being, financial future, time away, and professional development. With robust skills-building programs, multiple career progression paths, internal mobility, and a deeply collaborative culture, you'll have the opportunity to do meaningful work, expand your capabilities, and thrive as part of a global community. For details on total rewards in United States , visit ZS US office locations | Where we work | ZS .
Hybrid working model:
We are committed to giving our employees a flexible and connected way of working. A flexible and connected ZS allows us to combine work from home and on-site presence at clients/ZS offices for the majority of our week. The magic of ZS culture and innovation thrives in both planned and spontaneous face-to-face connections.
Travel:
Travel is a requirement at ZS for client facing ZSers; business needs of your project and client are the priority. While some projects may be local, all client-facing ZSers should be prepared to travel as needed. Travel provides opportunities to strengthen client relationships, gain diverse experiences, and enhance professional growth by working in different environments and cultures.
Considering applying?
At ZS, we honor the visible and invisible elements of our identities, personal experiences, and belief systems-the ones that comprise us as individuals, shape who we are, and make us unique. We believe your personal interests, identities, and desire to learn are integral to your success here. We are committed to building a team that reflects a broad variety of backgrounds, perspectives, and experiences. Learn more about our inclusion and belonging efforts and the networks ZS supports to assist our ZSers in cultivating community spaces and obtaining the resources they need to thrive.
If you're eager to grow, contribute, and bring your unique self to our work, we encourage you to apply.
ZS is an equal opportunity employer and is committed to providing equal employment and advancement opportunities without regard to any class protected by applicable law.
To complete your application:
An on-line application, including a full set of transcripts (official or unofficial), is required to be considered.
NO AGENCY CALLS, PLEASE.
Find Out More At:
www.zs.com
Salary: $155,000.00 - $167,750.00
What you'll do: Lead AI Engineer in the Platforms and Products will...
We are seeking a highly motivated Applied AI Engineer with a strong foundation in Machine Learning and a deep interest in Large Language Models (LLMs) and Generative AI. This role focuses on building, optimizing, and evaluating production-grade LLM systems, including Retrieval-Augmented Generation (RAG), fine-tuning workflows, and scalable inference pipelines.
- Design and implement LLM-powered applications using state-of-the-art transformer models.
- Build and optimize RAG pipelines using embeddings, chunking strategies, and vector search.
- Experiment with prompt engineering, structured outputs (JSON schemas/function calling), and tool-augmented LLMs (agents/workflows).
- Fine-tune models using techniques such as LoRA, PEFT, and instruction tuning.
- Develop and evaluate embedding models for similarity search and semantic retrieval.
- Conduct LLM evaluation using automated and human-in-the-loop techniques (offline + online).
- Optimize inference workflows for latency, GPU utilization, and cost efficiency (quantization, batching, caching).
- Build and maintain REST API Services (FastAPI etc.) to deploy LLM/RAG endpoints, integrate with product systems, and support scalable inference.
- Contribute to integration of AI systems into production software environments (CI/CD, monitoring, reliability).
- Research and prototype cutting-edge approaches in Generative AI and share learnings with the team.
What you'll bring:
- A master's or bachelor's degree in Computer Science or related field from a top university
- 4+ years' hands-on experience in Machine Learning (ML) with production LLM systems
- Good fundamentals of machine learning, deep learning and fine tuning models (LLM) including:
- Understanding of transformer architectures
- Prompt engineering expertise
- Embeddings and vector search
- Experienced in backend API design with FastAPI, async patterns, rate limiting
- Experience with vector DB including:
- Pinecone, Weaviate, or Chroma
- Embedding storage and similarity search
- Hybrid search implementations
- Strong programming expertise in Python is must including:
- Async programming (asyncio, async/await)
- Type hints and Pydantic
- SOLID principles and design patterns
- Experience in ML Ops to measure and track model performance including:
- MLFlow for model tracking
- Langfuse for LLM observability (strongly preferred)
- Model versioning and A/B testing
- Experience in working with NLP & computer vision
- Fluency in English
- Client-first mentality
- Intense work ethic
- Collaborative spirit and problem-solving approach
How you'll grow:
- Cross-functional skills development & custom learning pathways
- Milestone training programs aligned to career progression opportunities
- Internal mobility paths that empower growth via s-curves, individual contribution and role expansions
Perks & Benefits:
At ZS, your growth matters. We offer a comprehensive total rewards package that supports your health and well-being, financial future, time away, and professional development. With robust skills-building programs, multiple career progression paths, internal mobility, and a deeply collaborative culture, you'll have the opportunity to do meaningful work, expand your capabilities, and thrive as part of a global community. For details on total rewards in United States , visit ZS US office locations | Where we work | ZS .
Hybrid working model:
We are committed to giving our employees a flexible and connected way of working. A flexible and connected ZS allows us to combine work from home and on-site presence at clients/ZS offices for the majority of our week. The magic of ZS culture and innovation thrives in both planned and spontaneous face-to-face connections.
Travel:
Travel is a requirement at ZS for client facing ZSers; business needs of your project and client are the priority. While some projects may be local, all client-facing ZSers should be prepared to travel as needed. Travel provides opportunities to strengthen client relationships, gain diverse experiences, and enhance professional growth by working in different environments and cultures.
Considering applying?
At ZS, we honor the visible and invisible elements of our identities, personal experiences, and belief systems-the ones that comprise us as individuals, shape who we are, and make us unique. We believe your personal interests, identities, and desire to learn are integral to your success here. We are committed to building a team that reflects a broad variety of backgrounds, perspectives, and experiences. Learn more about our inclusion and belonging efforts and the networks ZS supports to assist our ZSers in cultivating community spaces and obtaining the resources they need to thrive.
If you're eager to grow, contribute, and bring your unique self to our work, we encourage you to apply.
ZS is an equal opportunity employer and is committed to providing equal employment and advancement opportunities without regard to any class protected by applicable law.
To complete your application:
An on-line application, including a full set of transcripts (official or unofficial), is required to be considered.
NO AGENCY CALLS, PLEASE.
Find Out More At:
www.zs.com
Salary: $155,000.00 - $167,750.00
ZS New York, New York, USA Office

The ZS NY office is located in the heart of Manhattan in the Empire State Building. The ZS Princeton office is located at 210 Carnegie Center, Princeton, NJ.
ZS Princeton, New Jersey, USA Office
ZS Princeton Office

210 Carnegie Center, Suite 400, Princeton, NJ, United States, 08540
Similar Jobs at ZS
Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
Lead business development and delivery of supply chain transformation engagements for high-tech and data center clients. Build client relationships, design analytics-driven solutions (inventory, demand/capacity planning, network design, supplier performance), manage cross-functional teams, present executive recommendations, and coach project staff.
Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
The AI Engineering Specialist will oversee project tasks, manage expectations, mentor junior members, and design scalable AI systems while working with advanced AI models and ML pipelines.
Top Skills:
AWSAzureCloudFormationDatabricksDjangoDockerFast ApiJavaScriptKubernetesNext JsPythonReact JsTailwind CssTerraform
Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
The Senior Engineer collaborates with teams, designs and implements technical features, writes production-ready code, and ensures high-quality deliverables, while also engaging in research and learning on new technologies.
Top Skills:
AWSAzureCi/CdDevOpsGCPJavaPythonScalaSpark
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory



