Ellipsis Health Logo

Ellipsis Health

Senior Software Engineer, Agents

Posted 3 Hours Ago
Be an Early Applicant
Hybrid
New York, NY, USA
160K-210K Annually
Senior level
Hybrid
New York, NY, USA
160K-210K Annually
Senior level
Build and ship production voice AI agents for healthcare, including conversation flows, prompts, tool calling, retrieval, memory, backend services, evaluations, monitoring, and observability. Improve agent quality, reliability, latency, and cost across language and speech systems. Partner with clinical, product, customer, and engineering teams to convert healthcare workflows into safe, effective patient-facing agents.
The summary above was generated by AI

Ellipsis Health builds AI products that take on healthcare's staffing shortages and administrative burden, pairing conversational AI with our patented voice biomarker technology to help deliver better healthcare for everyone. Our voice agents talk with patients every day: booking and rescheduling appointments, answering billing questions, handling medication refills, and checking in after a hospital visit.

This role sits on our provider engineering team, building the agents that health systems, provider groups, and FQHCs deploy with their patients. You'll work across the provider teams within Ellipsis, partnering with product, clinical, deployment, and commercial teams to take new agent workflows from idea to production.

We're seeking a Senior Software Engineer to build the AI agents patients actually talk to. Our agents hold real conversations with real patients every day, and each one has to be accurate, safe, fast, and kind. In this role, you'll own agents end to end: conversation design, prompts, tool calling, and evals, plus the APIs and data that make an agent work in production. This is a full-stack AI role, not a research-only seat. You'll take an idea from concept to an agent in front of patients quickly, then use live conversation data to make it better. In your first three months, you'll ship multiple production agents with our health system partners, build the eval suite every agent change must pass before it ships, and measurably improve how our agents perform in production.

You'll work directly with our SVP of Engineering and engineering leads, alongside product, clinical, and customer teams, on a small team where your work reaches production fast. The ideal candidate is a hands-on builder and fast learner who is comfortable with ambiguity, communicates clearly with engineers, nurses, and health system executives alike, and is motivated by making healthcare work better for patients.

Responsibilities
  • Design, build, and ship AI agents end to end, including conversation flows, prompts, tool and function calling, retrieval, memory, and the backend services agents depend on.

  • Build evaluation systems (offline test suites, simulated conversations, human review loops, and production monitoring) so we know an agent is good before and after it ships.

  • Improve instruction following, tool-calling reliability, latency, and cost across our LLM and speech stack.

  • Help design and build our next-generation voice agent platform, choosing the right models and architecture for each task based on quality, latency, and cost.

  • Partner with clinical, product, and customer teams to turn workflows like scheduling, refills, billing, and post-discharge check-ins into reliable agent behavior.

  • Dig into real conversations and failure cases, and close the loop with prompt, tool, model, or product changes.

  • Build internal tools to observe, monitor, and analyze agent behavior at scale to identify common failure modes and patterns.

  • Track what's new in models and tooling, and bring the useful parts into production quickly.

Qualifications
  • 5+ years of professional software engineering experience, including 1+ year building and shipping LLM-powered applications in production.

  • Strong proficiency in Python and/or TypeScript, comfortable across backend APIs and data, with enough frontend to ship a complete feature.

  • Hands-on experience with prompting, tool use and function calling, RAG, structured outputs, and agent orchestration.

  • Experience designing evals and using data to decide what to fix next.

  • Product sense: you care whether the patient got their appointment booked, not just whether the model metric moved.

  • Clear written and verbal communication with technical and non-technical teammates.

Preferred
  • Voice AI or real-time speech experience, including STT, TTS, voice activity detection and turn-taking, and telephony (Twilio, SIP, WebRTC).

  • Fine-tuning or post-training experience with open or hosted models.

  • Experience in healthcare or another regulated environment, including HIPAA, EHR, and FHIR.

  • Experience with workflow orchestration (e.g., Temporal).

  • Familiarity with LLM observability and tracing tools.

Salary and Benefits

We offer a competitive salary and meaningful equity, along with comprehensive health, dental, and vision insurance, a 401(k) plan, and [learning budget / conferences / additional benefits].

The typical salary range for this role is $160,000 to $210,000 USD, depending on skills, qualifications, and relevant experience.

Similar Jobs

One Month Ago
Hybrid
New York, NY, USA
180K-250K Annually
Senior level
180K-250K Annually
Senior level
Artificial Intelligence • Machine Learning • Software
Design and build backend systems for AI agent orchestration, tool execution, workflow management, memory, and state handling. Develop scalable APIs and reliable infrastructure for distributed AI workflows, improve platform reliability and observability, and partner with product, research, and engineering teams to deliver agent capabilities. Own technical initiatives from architecture through production, maintain software quality through testing and continuous delivery, and mentor engineers on backend and distributed-systems practices.
Top Skills: APIsAsynchronous ProcessingAutomated TestingAWSAzureCloud-Native ArchitectureContinuous DeliveryDistributed SystemsDockerGCPGoKubernetesObservabilityPythonRust
3 Months Ago
In-Office
New York, NY, USA
180K-220K Annually
Senior level
180K-220K Annually
Senior level
Artificial Intelligence • Information Technology • Machine Learning • Software
Design and build AI-driven agents and large-scale backend systems to improve efficiency in revenue organizations, ensuring reliability and scalability during high-volume processing.
Top Skills: Event-Driven SystemsKafkaLlmsPub/SubPythonTemporal
11 Minutes Ago
Hybrid
2 Locations
63K-140K Annually
Junior
63K-140K Annually
Junior
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Develop and deploy data solutions using Palantir Foundry and AIP for client engagements. Lead technical teams, coach team members, analyze system interactions, build applications with large datasets, and apply data engineering and analytics to deliver client outcomes. The role also includes managing client relationships, planning and executing projects, encouraging technology adoption, resolving stakeholder conflicts, and driving continuous improvement.
Top Skills: Artificial IntelligenceMachine LearningPalantir AipPalantir FoundryPythonTypescript

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account