Judi Health Logo

Judi Health

Senior Machine Learning Engineer I

Posted 7 Hours Ago
Be an Early Applicant
In-Office
New York, NY, USA
162K-202K Annually
Senior level
In-Office
New York, NY, USA
162K-202K Annually
Senior level
Design, develop, and productionize machine learning systems for document understanding, search, Q&A, GenAI, virtual agents, and RAG applications. Build Python backend services, AI APIs, multi-agent architectures, retrieval infrastructure, and CI/CD pipelines. Manage the full ML lifecycle, including training, validation, deployment, telemetry, A/B testing, and automated evaluation. Collaborate cross-functionally while ensuring scalable, secure, HIPAA-compliant healthcare solutions.
The summary above was generated by AI
About Judi Health

Judi Health is a health technology company providing benefit administration solutions to employers, unions, health plans, and government entities. Judi Health replaces fragmented, outdated systems with the industry's first Unified Claims Processing™ architecture, seamlessly consolidating pharmacy and medical benefit administration on a single, secure platform. By delivering true price transparency, eliminating unnecessary middleman fees, and leveraging advanced AI-powered care delivery, Judi Health helps clients achieve unprecedented operational efficiency and service levels.
At Judi Health, we're deploying the infrastructure our country needs to deliver the healthcare we all deserve. We are the intelligence platform powering benefits plans for millions of Americans and proudly leading the next generation of care. To learn more, visit www.judi.health.

Location: Hybrid 3 days (offices in NYC, Denver, CO and Charlotte, NC area)

Position Summary:

Join our mission to infuse cutting-edge AI/ML/GenAI into pharmacy benefits as a Senior Machine Learning Engineer. We are looking for an experienced software engineer with machine learning expertise to join us in expanding our AI capabilities, enabling increased productivity and magical experiences in our products and services.

In this role you will be expected to design and implement complex AI systems that leverage ML models for NLP, NLG, multimodal data analysis, chatbots, and RAG-based QnA. The ideal candidate should be passionate about applying AI/ML concepts to difficult problems and develop scalable solutions. We want people who like working in a collaborative team environment and enjoy creating practical, efficient, and high-performance software that leverages Large Language Models (LLM), Multimodal Language Models(MLM), and other ML models and techniques to build amazing capabilities for our customers, partners, and employees. Most importantly, we are a mission-oriented, high-growth startup and we are looking for folks that are excited to be part of our journey to make lasting impact towards transforming healthcare.

Responsibilities:

  • Design, develop, and productionize machine learning (ML) solutions in the fields of Document understanding, Search and QnA, GenAI, Virtual Agents, etc.

  • Develop and maintain backend services using Python, focusing on AI-driven applications.

  • Design and implement APIs for seamless integration with AI models and services.

  • Design multi-agent orchestration patterns (e.g. supervisor/subagent architectures, tool-use boundaries, human-in-the-loop gating) and evaluate architectural tradeoffs for scaling agent development across teams.
  • Contribute to the development and scaling of the retrieval/search infrastructure underlying RAG systems (e.g. vector search clusters, embedding pipelines, capacity planning) - Build and maintain CI/CD pipelines supporting the build, test, and deployment of agentic AI systems.
  • Collaborate with product managers, engineers, and other stakeholders as a specialist and subject matter expert in machine learning.

  • Work across the complete lifecycle of ML model development, including problem definition, data exploration, feature engineering, model training, validation, and deployment.

  • Participate in code reviews, testing, and quality assurance processes.

  • Troubleshoot and resolve technical issues related to AI model, integration, deployment and backend services.

  • Implement system telemetry, A/B testing and other statistical methods to validate the effectiveness of AI models. Ensure the integrity and robustness of ML solutions by developing automated testing and validation processes.

  • Document and communicate development processes, system designs, and architectural decisions.

  • Ensure the security and compliance of healthcare data, adhering to HIPAA regulations.

Required Qualifications:

  • Bachelor’s or Master’s degree in Computer Science, Machine Learning, or a related quantitative field.

  • Minimum 4+ years of experience in industry with a strong focus on ML solutions development and production deployment.

  • Strong grasp of OOP, Design Patterns, efficient algorithms, and quality software development.

  • Strong proficiency in Python and familiarity with ML libraries such as PyTorch.

  • Statistical Machine Learning and Artificial Intelligence in the context of NLP, Speech, RAG, Virtual Agents, and/or Document Processing technologies

  • Familiarity with cloud platforms such as AWS or Azure, including hands-on experience with containerized deployments

  • Familiarity with GenAI services such as OpenAI GPT, Anthropic Claude, Google Gemma etc. Experience developing and fine-tuning prompts on any of the GenAI services

  • Experience designing evaluation frameworks for non-deterministic/agentic AI systems
  • Excellent problem-solving skills, attention to detail, and a strong capacity for logical thinking.

  • Passion for customer, innovation, product quality, service excellence, and test engineering

  • The ability to work collaboratively across multiple disciplines in an extremely fast-paced, startup environment.

  • Experience working with microservices/an API-based application paradigm.

  • Good written communication skills that enable collaboration in a remote environment.

This position description is designed to be flexible, allowing management the opportunity to assign or reassign duties and responsibilities as needed to best meet organizational goals.

New York, NY Salary Range
$161,600$202,000 USD
Denver, CO Salary Range
$148,400$185,500 USD
Charlotte, NC Salary Range
$134,800$168,500 USD

All employees are responsible for adherence to the Judi Health Code of Conduct including the reporting of non-compliance. This position description is designed to be flexible, allowing management the opportunity to assign or reassign duties and responsibilities as needed to best meet organizational goals.

We provide equal employment opportunities to all employees and applicants for employment and prohibit discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, medical condition, genetic information, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. 

By submitting an application, you agree to the retention of your personal data for consideration for a future position at Judi Health. More details about Judi Health's privacy practices can be found at https://www.judi.health/legal/privacy-policy.

HQ

Judi Health New York, New York, USA Office

New York, NY, United States

Similar Jobs

One Month Ago
In-Office or Remote
140K-190K Annually
Senior level
140K-190K Annually
Senior level
Fintech • Machine Learning • Payments • Software • Financial Services
Lead end-to-end ML projects for fraud detection: develop, deploy, monitor, and iterate production models and experimentation frameworks. Improve model performance, build scalable ML pipelines, collaborate with Product/Engineering/Risk, and champion testing, documentation, and model-monitoring best practices to ensure robust, high-impact solutions.
Top Skills: Ml LibrariesPythonSparkSQL
27 Minutes Ago
Hybrid
65K-80K Annually
Entry level
65K-80K Annually
Entry level
Information Technology • Insurance • Software
Manages Vertafore’s Networks & Associations Program by coordinating partnership agreements, maintaining Salesforce and Excel data, supporting industry events, executing Marketo campaigns, developing marketing resources, and enabling sales teams. The role builds relationships with industry associations, coordinates webinars and communications, tracks program metrics, supports lead generation, and presents industry association updates to stakeholders and executives.
Top Skills: MarketoExcelSalesforce (Sfdc)
30 Minutes Ago
Remote or Hybrid
US
Mid level
Mid level
Information Technology
Manages technology projects from scope validation through delivery, overseeing schedules, budgets, resources, risks, quality, procurement, documentation, and client communication. Partners with engineers, sales, customers, and third-party consultants across multiple technology stacks. Leads cross-functional teams, negotiates scope and change, ensures profitability and stakeholder satisfaction, supports presales opportunities, and mentors associate project managers. Requires strong communication, project management methodology knowledge, and the ability to manage complex projects in professional services.
Top Skills: AICloudInfrastructureKanbanMS OfficeMicrosoft ProjectScrumSecurityWaterfall

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account