ServiceTitan Logo

ServiceTitan

Staff AI Engineer

Posted 2 Hours Ago
Be an Early Applicant
Remote or Hybrid
Hiring Remotely in US
202K-270K Annually
Senior level
Remote or Hybrid
Hiring Remotely in US
202K-270K Annually
Senior level
Lead the development of AI Voice Agents, mentor engineers, integrate foundational AI models, and drive cross-functional projects to improve customer interactions.
The summary above was generated by AI

Staff AI Engineer
Ready to be a Titan?
In this senior and highly influential position, you will drive the development of our cutting-edge AI Voice Agents and conversational systems. You will act as the primary technical leader for the product, navigating ambiguity and delivering robust, scalable solutions that redefine customer experiences. You will engage with leadership across engineering, infrastructure, data science, and product growth. We build for perfection, use Python and the most modern tools on Azure Cloud, have an amazing culture, and love to solve complex, real-time problems.

What you'll do:

  • Contribute significantly to the technical roadmap for the AI Voice Agent system and ensure execution aligns with product and business goals.

  • Serve as the technical lead and subject matter expert for critical projects, actively mentoring and guiding engineers on best practices in AIOps, LLMOps, system design, and implementation excellence.

  • Collaborate with product teams to integrate and operationalize Foundational Models (like LLMs) and specialized speech models into production, focusing on high-volume, low-latency API usage, cost-efficiency, and resilience.

  • Drive execution for complex, cross-functional projects, proactively identifying and resolving technical blockers in infrastructure, deployment, and real-time performance optimization.

  • Communicate effectively with executives, product managers, customers, and partners, translating complex technical challenges into clear implementation plans and strategic recommendations.

What you'll bring:

  • 8+ years of experience writing production-level code in Python.

  • 3+ years of experience designing, deploying, and maintaining high-volume, low-latency production AI/ML systems, specifically Conversational AI models, ASR/TTS engines, or real-time NLP systems.

  • Deep expertise in designing and deploying large-scale, fault-tolerant AI inference services and distributed systems to support real-time voice agents.

  • Strong understanding of the Conversational AI and Machine Learning project lifecycle.

  • Advanced knowledge of Machine Learning methods and algorithms across traditional ML methods and Deep Learning theory and techniques.

  • Expertise in leveraging and orchestrating Foundational Models using tools like LangChain, LangGraph, or equivalent frameworks, including state-of-the-art prompting, agent design, and RAG (Retrieval-Augmented Generation) techniques.

  • Experience with Reinforcement Learning (RL) techniques and implementing Continuous Learning/Online Optimization systems for production.

  • Experience with deep learning frameworks (PyTorch, TensorFlow) and NLP/Speech-focused libraries (e.g., Hugging Face Transformers, DeepSpeech, Kaldi/ESPnet).

  • Expert-level knowledge of data storage and analytics technologies (SQL Server, PostGreSQL, Redshift, Snowflake).

  • Extensive experience with public cloud environments such as Azure or AWS, including security, cost management, and cloud-native architecture.

  • Proven ability to architect solutions using microservices and asynchronous messaging technologies like Kafka, Azure ServiceBus, etc. (critical for high-volume, real-time interactions).

  • Experience with serverless architecture (Azure Functions, AWS Lambda, etc.).

  • Experience with Azure Cognitive Services (Speech/Bot Service) or similar cloud-based AI offerings is a significant plus.

  • Expert command of Git, unit testing, debugging, profiling, and modern SDLC tools.

  • Demonstrated ability to provide technical leadership and operate effectively in a fast-paced environment with a globally distributed team.

Be Human With Us:

Being human isn’t about checking every box on a list. It’s about the experiences we have, people we meet, and the perspectives we share. So, if you have the skills but are hesitant to apply because of your background, apply anyway. We need amazing people like you to help us challenge the conventional and think differently about the problems that we’re solving. We’re in this together. Come be human, with us. 

What We Offer:
When you join our team, you’re not just accepting a job. You’re making a career move. Here’s how we’ll support you in doing some of the most impactful work of your career:

  • Flextime, recognition, and support for autonomous work: Flexible time off with ample learning and development opportunities to continue growing your career. We offer a comprehensive onboarding program, leadership training for Titans at all levels, and other programs and events. Great work is rewarded through Bonusly, peer-nominated awards, and more.

  • Holistic health and wellness benefits: Company-paid medical, dental, and vision (with 100% employer paid options and 90% coverage for dependents), FSA and HSA, 401k match, and telehealth options including memberships to One Medical.

  • Support for Titans at all stages of life: Parental leave and support, up to $20k in fertility services (i.e. IUI and IVF), surrogacy, and adoption reimbursement, on demand maternity support through Maven Maternity, free breast milk shipping through Maven Milk, pet insurance, legal advisory services, financial planning tools, and more.

At ServiceTitan, we celebrate individuality and uniqueness. We believe that the convergence of fresh perspectives and experiences from all walks of life is what makes our product and culture so great. We strongly encourage people from underrepresented groups to apply. We do not discriminate against employees based on race, color, religion, sex, national origin, gender identity or expression, age, disability, pregnancy (including childbirth, breastfeeding, or related medical condition), genetic information, protected military or veteran status, sexual orientation, or any other characteristic protected by applicable federal, state or local laws.

ServiceTitan is committed to fair and equitable compensation for all of our employees. We thoughtfully consider a wide range of factors when determining individual compensation.The expected salary range for this role for candidates residing in the United States is between $202,000 USD - $270,200 USD. Compensation for candidates residing outside the United States will vary by location and the specific salary range will be discussed during the hiring process. Actual compensation for an individual may vary depending on skills, performance over time, qualifications, experience, and location. In addition to the base salary, the total compensation package also includes an annual bonus, equity and a holistic suite of benefits.

Top Skills

Aiops
Aws Lambda
Azure Cloud
Azure Functions
Azure Servicebus
Deepspeech
Espnet
Hugging Face Transformers
Kafka
Kaldi
Llmops
Postgres
Python
PyTorch
Redshift
Snowflake
SQL Server
TensorFlow

Similar Jobs

6 Days Ago
Easy Apply
Remote or Hybrid
USA
Easy Apply
180K-270K Annually
Senior level
180K-270K Annually
Senior level
Healthtech • Information Technology • Software • Telehealth
Design, build, and maintain scalable software systems for Zocdoc's AI Phone Assistant, integrating AI workflows, leading system optimization, and collaborating across teams to enhance healthcare communication.
Top Skills: C#Conversational AiLarge Language Models
2 Hours Ago
Remote
United States
201K-236K Annually
Senior level
201K-236K Annually
Senior level
Healthtech • Other • Social Impact • Software • Telehealth
As a Staff AI Engineer at Rula, you'll design and scale AI systems for mental healthcare, focusing on generative AI and improving patient outcomes through safe and reliable technology.
Top Skills: AWSDspyFaissGCPGoHaystackJavaJavaScriptLangchainLlamaindexMilvusPineconePythonTypescriptWeaviate
2 Days Ago
Remote or Hybrid
8 Locations
195K-343K Annually
Expert/Leader
195K-343K Annually
Expert/Leader
Consumer Web • Information Technology • Mobile • Music • News + Entertainment • Software
Lead strategic AI and ML initiatives for Tidal by developing personalization systems and collaborating with cross-functional teams. Responsible for technical leadership and system architecture.
Top Skills: AWSDatabricksPysparkPyTorch

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account