The Senior ML Engineer will develop LLM-based applications, predictive models for patient outcomes, and evaluation frameworks to optimize AI in healthcare.
About Kouper Health
Kouper is redefining how care transitions happen. Backed by General Catalyst, CVS Health Ventures, 25madison, and leading health system partners, we’re on a mission to bridge the care transition gap and fundamentally improve the patient experience — helping people live longer, healthier lives.
Position Overview:
We're looking for a Senior ML Engineer to build the AI systems that power personalized patient engagement at scale. You'll develop and optimize LLM-based applications, build predictive models for patient outcomes, and create the evaluation frameworks that ensure our AI delivers on its promise. This is a foundational role where you'll shape how we apply machine learning to transform healthcare.
Responsibilities
- Design and build LLM-powered applications for patient communication and care navigation
- Develop predictive models for patient engagement, risk stratification, and care optimization
- Build robust evaluation frameworks and metrics to measure model quality, safety, and clinical appropriateness
- Architect ML systems that handle diverse healthcare data sources while maintaining privacy and compliance
- Optimize model performance for latency, cost, and quality across production workloads
- Collaborate with product and clinical teams to translate healthcare problems into ML solutions
- Stay current on ML research and bring relevant innovations into production applications
- Partner with backend engineers to integrate ML systems into the broader platform architecture
Qualifications
- 5+ years of experience in machine learning engineering with at least 2 years working with LLMs or NLP systems
- Strong proficiency in Python and ML frameworks (PyTorch, TensorFlow, Hugging Face)
- Hands-on experience building and deploying LLM-based applications in production
- Deep understanding of modern ML techniques: fine-tuning, prompt engineering, RAG, embedding models
- Experience designing evaluation frameworks and metrics for ML system quality
- Strong software engineering fundamentals with ability to write production-quality code
- Excellent problem-solving skills and ability to translate ambiguous requirements into technical solutions
Preferred Qualifications
- Experience with healthcare AI applications or clinical NLP
- Background in conversational AI, dialogue systems, or voice-based applications
- Research experience or publications in ML/NLP
- Familiarity with healthcare data standards (HL7, FHIR) and privacy requirements (HIPAA)
- Experience with ML infrastructure and MLOps (model serving, monitoring, feature stores)
What We Offer
- Competitive salary and equity package
- Flexible work environment and remote options
- Comprehensive health, dental, and retirement benefits
- The chance to make a significant impact in a mission-driven startup focused on transforming patient care
- Location: NYC, SF, or Remote
- Expected Start Date: Feb 2026
Top Skills
Hugging Face
Python
PyTorch
TensorFlow
Kouper New York, New York, USA Office
817 Broadway, 7th Floor, New York, NY , United States, 10003
Similar Jobs
.png)
Big Data • Healthtech • HR Tech • Machine Learning • Software • Telehealth • Big Data Analytics
The Senior Machine Learning Engineer will lead technical strategy, build and maintain ML systems, and enhance engineering practices while ensuring data security and compliance.
Top Skills:
AirflowAWSClaude CodeDbtDltKubernetes
Consumer Web • Healthtech • Professional Services • Social Impact • Software
As a Senior Machine Learning Engineer, you will design and build ML models for patient-provider matching, focusing on personalization and ranking. Responsibilities include model development, A/B testing, and collaborating across teams to improve patient experiences.
Top Skills:
CatboostPythonPyTorchScikit-LearnTensorFlow
Fintech • Machine Learning • Payments • Software • Financial Services
As a Senior Machine Learning Engineer at Capital One, you'll design, build, and deploy ML models, collaborate in Agile teams, and ensure the performance of ML applications. Responsibilities include model training, monitoring, and optimization in cloud-based environments.
Top Skills:
AWSAzureDaskGoogle Cloud PlatformJavaPythonPyTorchScalaScikit-LearnSparkTensorFlow
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
