Arya Health Logo

Arya Health

Senior Software Engineer, AI

Posted Yesterday
Be an Early Applicant
In-Office
New York, NY, USA
180K-250K Annually
Senior level
In-Office
New York, NY, USA
180K-250K Annually
Senior level
Design, prototype, and deploy production-ready AI features using LLMs and orchestration tools. Build scalable APIs, implement monitoring/safety, integrate Vertex AI/OpenAI, and lead AI integration projects with product and engineering.
The summary above was generated by AI

Our mission is simple but ambitious: to use AI to fix the broken economics and lost humanity of care. If you want to move fast and help build the future of healthcare with heart, you belong at Arya.

About the Role

We’re looking for a Senior Software Engineer in AI to join our team and embed intelligence into Arya’s workforce platform. You won’t be building foundation models—but you’ll be working with LLMs and AI toolkits to orchestrate workflows, automate decision-making, and improve how customers interact with Arya. Our team partners with Google’s Vertex AI group to shape their Agent development kit, and we’re looking for an engineer who can turn these cutting-edge tools into production-ready solutions for scheduling, shift eligibility, workforce management, and more.

As a senior member of the engineering team, you’ll work closely with our Principal Architect and own AI-driven projects end-to-end: designing, prototyping, and deploying systems that make work smarter, more automated, and more intuitive for our customers.

What You'll Do
  • Design and implement AI-powered workflows using Vertex AI Agents, Pydantic, Bland.ai and other orchestration frameworks.

  • Integrate LLMs into customer workflows (e.g., natural language scheduling, eligibility insights, onboarding automation).

  • Build scalable APIs and services that serve AI features reliably in production.

  • Implement evaluation, monitoring, and safety checks to ensure AI systems are accurate, fair, and trustworthy.

  • Collaborate with Product and Engineering to identify practical, high-impact AI use cases.

  • Document integration patterns and best practices for AI deployment.

  • Provide technical leadership and mentorship on AI integrations.

What This Role Is Not
  • ❌ You won’t be training LLMs or building foundation models from scratch.

  • ❌ You won’t be focused on academic research or publishing papers.

  • ❌ You won’t be working in isolation — this role is highly collaborative with product and engineering teams.

  • ❌ You won’t be building experimental prototypes only; you’ll be delivering production-ready, customer-facing AI features.

This role is about applied AI engineering: using the best tools available (Vertex AI, OpenAI APIs, RAG pipelines, vector databases) to solve real-world customer problems.

What We’re Looking For
  • 5+ years of software engineering experience, with 2+ years working with LLMs or AI frameworks.

  • Strong programming skills in Python or Node.js; familiarity with Pydantic and MCP architecture.

  • Expert in SQL and proficient with Postgres optimization.

  • Hands-on experience with Vertex AI, OpenAI, or other model APIs.

  • Familiarity with CI/CD pipelines and cloud environments (GCP preferred).

  • Experience designing APIs and backend services that integrate AI features at scale.

  • Clear communication skills and a collaborative, pragmatic mindset.

Nice to Have
  • Experience with retrieval-augmented generation (RAG) pipelines and vector databases.

  • Exposure to compliance-aware AI systems in regulated industries.

  • Contributions to open-source AI/LLM frameworks.

  • Knowledge of monitoring/evaluation techniques for AI systems.

What to Expect in the First 90 Days

By Day 15 — Onboarding & Environment Setup

  • Fully onboarded into Arya’s AI stack and workflows.

  • Review existing AI integrations (Vertex AI, orchestration pipelines).

  • Ship one small improvement to an AI workflow or feature.

  • Draft notes on gaps or opportunities for automation.

By Day 30 — Initial Contributions & Familiarity

  • Ship your first AI-driven feature (e.g., LLM-powered scheduling helper, onboarding workflow) to staging or production.

  • Implement monitoring or evaluation improvements for an existing AI pipeline.

  • Partner with Product to scope a new AI use case.

  • Contribute to code reviews for AI-related PRs.

By Day 60 — Ownership of Integration Scope

  • Fully own one or more AI workflows from experimentation through monitoring.

  • Ship at least one high-impact improvement (e.g., reducing latency, improving response reliability).

  • Document and share best practices for LLM integrations.

  • Join customer calls to understand workflow pain points where AI can help.

By Day 90 — Scaling & Strategic Impact

  • Design and deploy an automation to streamline AI workflow deployment or evaluation.

  • Lead a cross-functional effort to improve workflow automation by 25%+.

  • Propose and implement architecture changes to support future AI use cases at scale.

  • Mentor a junior engineer or new hire on Arya’s AI stack.

  • Present a “State of AI at Arya” review to the engineering team.

OUR VALUES

You will thrive at Arya if you can:

1. Think Like a Customer

We win by making our Customers feel like superheroes. This means we must always view our decisions, actions and communication through the lens of our Customers.

2. Find Small Wins Everyday

We believe that speed of making decisions and taking action have a compounding effect. A series of quick, small, daily wins add up to big ones over time, and the absence of these can add up to big losses.

3. Teach and Learn Consistently

We believe that giving context and sharing expertise is everyone's responsibility. We find time to talk about the Why and How of what we do in every interaction.

4. Be Prepared

We believe that progress cannot be left to chance and sudden flashes of genius. We put in the time and effort to prepare ourselves and others to make the most of every opportunity.

5. Communicate Simply

We communicate to be understood. This means that in a complex, global and busy world, we work hard to express our ideas in ways that others find simple and intuitive.

6. Be Kind

We believe that being exceptional and being kind are not mutually exclusive. We strive to treat others with empathy, kindness and respect, even in the most challenging of times.

WHAT WE OFFER

Arya is committed to being transformative to the careers of those who share our values, and are looking to build a generational business. We offer:

The Basics:

  • Competitive salary + equity

  • Comprehensive health and wellness benefits

  • Flexible PTO and generous parental leave

  • Performance-based incentives

  • Wellhub subscription with access to premium fitness facilities, team workouts

The Multipliers:

  • Be part of a company that treats its values as its biggest priority

  • Learn more about building and scaling a business in months than others will in years

  • Have ownership, influence and impact that runs far and wide

  • Work flexibly, with a focus on progress over activity

  • Never sacrifice your mental health- while we work hard, we're committed to avoiding burnout at all costs

Arya Health provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, genetics, sexual orientation, gender identity, or gender expression. We are committed to a diverse and inclusive workforce and welcome people from all backgrounds, experiences, perspectives, and abilities.

HQ

Arya Health New York, New York, USA Office

85 5th ave, New York, NY, United States, 10003

Similar Jobs

2 Days Ago
Easy Apply
Hybrid
New York, NY, USA
Easy Apply
113K-252K Annually
Senior level
113K-252K Annually
Senior level
Fintech • Information Technology • Payments • Productivity • Software • Travel • Automation
Build production LLM-powered, agentic loyalty product experiences across frontend, backend, and AI orchestration. Implement tool-calling, structured outputs, guardrails, evals, monitoring, and personalization using loyalty and trip data. Collaborate cross-functionally and own code quality, observability, testing, and operational support for customer-facing features.
Top Skills: Agentic SystemsAPIsAsync WorkflowsCachingDistributed SystemsEval PipelinesJavaLlmsNode.jsObservabilityPythonRagStreaming ChatTool CallingTypescript
15 Days Ago
In-Office
New York, NY, USA
182K-242K Annually
Senior level
182K-242K Annually
Senior level
Cloud • Information Technology • Machine Learning
Design and build production-grade full-stack, AI-enabled applications. Develop React/Next.js frontends, backend services on Kubernetes, integrate LLM/AI features, connect data platforms, implement CI/CD, automated testing, observability, and ensure secure, high-performance APIs and services.
Top Skills: Ai/MlAutomated TestingC#Ci/CdDockerGoGrpcHelmJavaJavaScriptKafkaKubernetesLlmNext.JsObservabilityPythonReactRestSparkTypescript
21 Days Ago
Easy Apply
Hybrid
New York City, NY, USA
Easy Apply
172K-226K Annually
Senior level
172K-226K Annually
Senior level
Cybersecurity • Industrial
Ship full‑stack features end-to-end using AI coding agents, drive architecture and technical direction, collaborate with Product and Design, write scalable maintainable code, mentor engineers, document work, and translate industrial automation customer problems into engineering tasks.
Top Skills: C#Ci/CdClaude CodeCopilotCursorGoTypescript

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account