Senior ML Ops Engineer

About Alaffia & Our Mission

Each year, the U.S. healthcare system suffers from over $500B in wasted spending due to medical billing fraud, waste, and administrative burden. At Alaffia, we’re committed to changing that paradigm. We’ve assembled a team of clinicians, AI engineers, and product experts to build advanced AI solutions that will directly bend the cost curve for all patients across the healthcare ecosystem. Collectively, we’re building best-in-class AI software to provide our customers with co-pilot tools, AI agents, and other cutting-edge solutions to reduce administrative burden and reduce healthcare costs. 

We’re a high-growth, venture-backed startup based in NYC and are actively scaling our company.

About the Role & What You'll Be Doing

Alaffia is a healthcare AI startup revolutionizing health and data automation. Our AI-driven platform leverages state-of-the-art generative AI and machine learning technologies to enhance accuracy, efficiency, and compliance in medical billing and auditing. As we scale, we are seeking a Senior AI Ops Engineer to build the cutting-edge AI solutions, drive innovation, and shape the future of healthcare automation.

At Alaffia, AI is at the core of our mission. We are seeking an experienced engineer who is passionate about deploying scalable, safe, and regulatory-compliant AI-driven systems. Our AI technology powers intelligent automation for medical billing, ensuring accuracy and operational efficiency. We seek someone who thrives on building large-scale AI systems that enhance workflow efficiency, while also prioritizing all the necessary safety guardrails for responsible AI. You will have the opportunity to orchestrate various AI agents with an optimized system design that integrates AI platforms, data storage, and human-in-the-loop feedback. In this role, you’ll be shaping the future of AI-driven healthcare automation while tackling some of the most significant challenges in AI deployment and monitoring.

Your Responsibilities

• Deploy NLP, OCR, and multi-modal AI products on secure cloud  environments.
• Design AI system, focusing on pipeline architecture and tooling to ensure scalability, observability, performance, latency and fault tolerance requirements
• Design data schema and develop ETL processes to integrate data and human annotation with AI model tuning and benchmarking pipelines.
• Create best practices for data and AI experiment management
• Write highly robust, scalable code that is flexible, reusable, and adaptable to evolving requirements.
• Ensure high code quality through rigorous code review processes and foster a collaborative engineering culture.
• Build and leverage AI tools to improve developer efficiency and alignment across teams.
• Proactively identify, resolve, and mitigate technical risks before deployments and releases.

What We're Looking For

• 8+ years of technical experience, with at least 4+ years in a dedicated software engineering role
• Strong background in data modeling, versioning, and storage for AI data and annotation
• Recent development experience of scalable enterprise AI products
• Proficient in multiple AI frameworks, for example, MLFLow, LangChain, LangFuse, CrewAI, Weights & Bias
• Firm understanding of AI software development and quality assurance procedures
• Working knowledge and design skills across a wide array of databases
• Experience with AI experiment tracking, monitoring, and comparison
• Demonstrated ability to stay up to date with the latest AI methodologies and systems.
• Exceptional problem-solving skills and the ability to work in a fast-paced, evolving environment.
• Excellent communication and collaboration skills, with the ability to articulate complex technical concepts to non-technical stakeholders.

Our Culture

At Alaffia, we fundamentally believe that the whole is more valuable than the sum of its individual parts. Further to that point, we believe a diverse team of individuals with various backgrounds, ideologies, and types of training generates the most value. Our people are entrepreneurial by nature, problem solvers, and are passionate about what they do — both inside and outside of the office.

What Else Do You Get?

• Competitive compensation package
• Medical, Dental and Vision benefits
• Flexible, paid vacation policy
• Work in a flat organizational structure — direct access to Leadership