Easy Apply
Easy Apply
Build and ship production LLM-powered features across patient-facing products, clinical workflows, and internal tools. Implement AI application layers (prompt orchestration, tool calling, RAG, agent workflows), connect LLMs to internal APIs and systems, and develop evaluation suites and observability for model quality. Prototype rapidly, collaborate with clinical teams, and contribute to AI infrastructure and engineering best practices.
Join Tech @ Ro to build the future of healthcare, from the ground up!
At Ro, we believe that when people achieve their health goals, they can achieve their life goals. The highest-leverage way to move society forward is to give people their health, and the current healthcare system isn’t built to do that. It was built to bill, not to serve patients.
We’re building a new system. One where the patient is in control. One designed from scratch for the digital age.
At Ro, technology isn’t just a function… It's core to how we deliver care. We’ve built a vertically integrated healthcare platform that connects telehealth, diagnostics, pharmacy, and logistics into a seamless, end-to-end experience for millions of patients.
…and we’re just getting started.
As part of Tech @ Ro, you’ll work on systems that operate at scale, with an opportunity to:
- Solve complex, high-concurrency problems across a full-stack platform
- Build and ship quickly with tight feedback loops and real-world impact
- Own systems end-to-end, from architecture to production performance
- Work alongside experienced operators, technical leaders, and clinicians
- Help define how modern healthcare should be delivered
We’re a performance-driven team with a strong sense of ownership and urgency. We move fast, learn quickly, and hold a high bar for what we build, and do so with a big heart — because patients depend on it.
If you’re motivated by impact, scale, and the chance to help lead the patient revolution, come build with us.
Ro is building a team focused on shipping LLM-powered products across the patient experience, clinical operations, and internal tooling.
We're hiring an AI Engineer to join a new team we're building from the ground up alongside a Senior AI Lead and an Engineering Manager. You'll build AI-powered features from prototype through production while learning from experienced AI engineers. Most of your work will involve building orchestration layers, prompts, evaluations, retrieval systems, and tooling that make LLMs reliable enough for real-world healthcare operations.
What You'll Do
- Build and ship production LLM-powered features across patient-facing products, clinical workflows, and internal tools.
- Build the AI application layer, including prompt orchestration, tool calling, retrieval (RAG), agent workflows, and structured outputs.
- Develop and iterate on evaluation suites, including synthetic test datasets, LLM-as-a-judge evaluations, regression tests, and human review workflows to improve quality over time.
- Write the code that connects LLMs to Ro's internal systems, APIs, and operational workflows.
- Partner closely with EHR operators, Patient Advocates, and clinical teams to understand the workflows you're automating and identify opportunities for AI.
- Prototype quickly, ship early, measure outcomes, and iterate based on real-world usage.
- Contribute to AI infrastructure, tooling, and engineering best practices alongside senior engineers.
What You’ll Bring to the Team
- 1–4 years building software, with hands-on experience building LLM-powered applications through work, internships, research, school, hackathons, or side projects.
- Strong Python engineer with experience building backend services or developer tools.
- Comfortable using AI-assisted development tools throughout the software development lifecycle (or excited to learn).
- You've built at least one LLM-powered application or feature that you're excited to walk us through, including the technical decisions you made and what you learned.
- You enjoy learning quickly, experimenting with new technologies, and working in an environment where best practices are still evolving.
- You have strong problem-solving skills and are comfortable working through ambiguity with support from experienced teammates.
- Bonus: Experience with orchestration frameworks (e.g. LangChain, LangGraph, AgentCore), RAG architectures, vector databases, prompt/version management, or evaluation and observability platforms (e.g. LangSmith, Braintrust, Arize Phoenix).
A note on reporting structure
This is a new function at Ro, and we're being deliberate about not over-defining it. Your manager and where you sit on the org chart will depend on the specific shape of the team we end up with. We'd rather find the right people and figure out the lines around them than pre-draw boxes and miss great candidates. If that ambiguity is a deal-breaker, this isn't the right role; if it sounds like an opportunity, we want to talk.
-
The target base salary for this position ranges from $149,600 - $184,000, in addition to a competitive equity and benefits package (as applicable). When determining compensation, we analyze and carefully consider several factors, including location, job-related knowledge, skills and experience. These considerations may cause your compensation to vary.
Ro is consistently recognized as a top workplace in Health Care, in New York, and for Women and Parents—earning more than 20 honors from Fortune, Great Place to Work, and PEOPLE since 2021. In 2025 alone, we ranked top 5 among medium workplaces in Health Care and New York, and top 50 nationwide.
At Ro, we believe that our diverse perspectives are our biggest strengths — and that embracing them will create real change in healthcare. As an equal opportunity employer, we provide equal opportunity in all aspects of employment, including recruiting, hiring, compensation, training and promotion, termination, and any other terms and conditions of employment without regard to race, ethnicity, color, religion, sex, sexual orientation, gender identity, gender expression, familial status, age, disability and/or any other legally protected classification protected by federal, state, or local law.
Ro is committed to providing reasonable accommodations for qualified individuals with disabilities in our application and interview process. If you require a reasonable accommodation in the application or interview process, please contact us at [email protected].
See our California Privacy Policy here.
Ro (Ro.co) New York, New York, USA Office
Ro (Ro.co) Ro HQ Office
625 6th Ave, 4th Floor, New York, NY, United States, 10011
Similar Jobs at Ro (Ro.co)
.png)
Healthtech • Pharmaceutical • Telehealth
Build and ship LLM-powered production features end-to-end: prompt orchestration, tool calling, retrieval/RAG, embeddings, evaluation infrastructure, observability, safety guardrails, and integrations. Collaborate with clinical teams, prototype quickly, measure outcomes, and raise engineering standards through mentorship and technical leadership.
Top Skills:
Ai Apis And FrameworksBackend ServicesLlmsPython
Healthtech • Pharmaceutical • Telehealth
Build and ship LLM-powered features across patient and clinical workflows. Partner with clinical operators, prototype AI workflows (prompts, agents, RAG), write Python/SQL to connect AI systems, define success metrics, run evaluations, and iterate based on user feedback.
Top Skills:
Agent WorkflowsEhr SystemsLarge Language Models (Llms)Orchestration FrameworksPromptingPythonRetrieval-Augmented Generation (Rag)SQL
Healthtech • Pharmaceutical • Telehealth
Embed with clinical and operations teams to identify high-value AI opportunities; build LLM-powered features end-to-end including prompts, orchestration, Python services, evaluation suites, golden datasets, and metrics-driven experiments to measure product impact and prioritize work.
Top Skills:
APIsEvaluation SuitesLlmsModel OrchestrationPrompt EngineeringPython
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
