Rilla Logo

Rilla

Software Engineer, Applied AI

Reposted 3 Months Ago
In-Office
New York City, NY, USA
200K-300K Annually
Mid level
In-Office
New York City, NY, USA
200K-300K Annually
Mid level
As an AI Engineer, you'll develop AI-powered systems that allow human-machine interaction through voice, focusing on data-driven insights and real-world audio processing.
The summary above was generated by AI
A Foundational Company

Rilla is on a mission to index the offline world.
Today, we’ve built the leading sales coaching software for organizations doing sales offline. We have over 1000 customers, including The Home Depot, KKR, Neighborly, and PulteGroup, using our product to enable AI sales coaching across their organization.
We are backed by Google Ventures, Bessemer Ventures, Crew Capital, and Broom Ventures, along with others.
We’re an in office team in NYC with builders who operate like high speed reinforcement learners. We obsess over our customers, move at a high velocity, are not afraid of failure, and look to maximize our real-world impact.
If you want to build the products and systems for how billions of conversations in the real world are captured and indexed, Rilla is the place to do it.

The Role

The Applied AI team at Rilla is redefining how humans interact with machines—using voice, intelligence, and a whole new class of data.

Every day, you’ll architect and ship AI-powered systems that make it possible for people to talk to Rilla like they would a human. You’ll help build agents that operate natively on real-world audio, extract insights from conversations no one else can even access, and push the boundaries of what’s possible in AI.

We’re building:

  • A voice-first interface that lets users command Rilla directly through natural speech

  • A search engine that uncovers business-critical insights from voice data that’s never been searchable

  • A first-of-its-kind audio intelligence pipeline—designed for the messy, noisy, wildly unstructured conversations that happen in the real world, not in an online meeting

As an early AI engineer, you’ll shape the foundations of our AI stack and drive the invention of new techniques, tooling, and models. You’ll work across the full AI lifecycle—from data acquisition to real-time inference and user-facing chat interfaces.

If you’re obsessive about your craft, think like a founder, and want to be on the frontier of voice and offline AI, this is your team. The scale of the problems we’re solving is unmatched—and the surface area for ownership is only getting bigger.

Technologies We Use
  • We work primarily in Python and TypeScript, with FastAPI for API development

  • AI/ML technologies including PyTorch, OpenAI APIs, Baseten, and LiteLLM

  • Cloud infrastructure with AWS and LiveKit for real-time communications

  • PostgreSQL, Redis, and S3 for data storage

What We Value
  • An infinite learner. Someone who is relentless in their curiosity.

  • A customer obsessive. Someone who deeply care about delighting customers and solving real pains, not vanity metrics.

  • A winning attitude. You thrive with extreme accountability, learning as a team, and both giving and receiving rapid feedback.

  • Extreme empathy. Our customers are not tech companies. They live and work in the real world. Empathy is critical to arriving at correct solutions.

  • Unafraid of failure. You take risks. You see failure as an opportunity to learn, grow, and be better the next time. In a weird way, you trick your brain into being excited when you fail, because it means you got a new opportunity to learn more.

What We Require
  • Experience building and deploying AI/LLM systems in production

  • Familiarity with tools that power today's AI: eval frameworks, agent tooling, and prompt engineering

  • Comfort working directly with customers to understand their needs and solve real-world problems

Don’t Work Here

Please don't join if you're not excited about:

  1. Building an AI product for an industry untouched by modern software

  2. Constantly talking to and visiting customers in the field

  3. Working ~60 hrs/week in person with some of the most ambitious people in NYC

  4. Attempting to build a generational company, and the intensity required to do so

Compensation

The estimated salary range for this position is $200,000 - $300,000/year.

Successful candidates with competing offers will receive matching and competitive offers.

Total compensation for this position may also include Incentive Stock Options, sign-on bonus, and other potential future incentives. This estimate excludes the value of any potential sign-on bonus; the value of any benefits offered; and the potential future value of any long-term incentives.

Our benefits aim to empower Rilla employees in removing roadblocks to achieving their life’s work. The list below details our available benefits and some of the perks that can be enjoyed as an employee of Rilla.

Benefits
  • Medical, dental, and vision insurance

  • Breakfast, lunch, dinner, and supplementary food and drink

  • 401(k) retirement plan

  • Gym membership

  • Commuter benefits

  • Relocation assistance

  • Take what you need paid time off, not accrual based

  • $1,000 stipend for learning and personal growth

  • $1,500 a month rent stipend

  • Tech equipment

HQ

Rilla New York, New York, USA Office

28-07 Jackson Ave, New York, New York, United States, 11101

Rilla New York, New York, USA Office

28-07 Jackson Avenue, New York, United States, 11101

Similar Jobs

14 Days Ago
Hybrid
New York, NY, USA
145K-200K Annually
Entry level
145K-200K Annually
Entry level
Artificial Intelligence • Software
Build and deploy AI agents for defense and intelligence users. Responsibilities include designing agent workflows, improving performance through evaluations and fine-tuning, developing intuitive interfaces, collaborating with users and cross-functional teams, and owning features from experimentation through production. The role emphasizes scalable, reliable, low-latency applications, complex data processing, and practical use of large language models to support mission-critical workflows.
Top Skills: C++JavaJavaScriptLarge Language Models (Llms)PythonReactTypescript
7 Days Ago
In-Office
New York, NY, USA
240K-300K Annually
Senior level
240K-300K Annually
Senior level
Artificial Intelligence • Information Technology • Logistics • Software • 3PL: Third Party Logistics • Industrial • Manufacturing
Build and lead scalable AI-powered platform systems for Traba’s staffing marketplace. Responsibilities include integrating AI agents and frontier models into production, architecting real-time matching and autonomous vetting pipelines, owning platform architecture, and driving backend performance, reliability, and scale. The role also involves partnering with the CTO, leading projects, and setting engineering standards in an early-stage environment.
Top Skills: AIDistributed SystemsKafkaLlmsNode.jsPostgresPythonRabbitMQTypescript
21 Days Ago
Hybrid
New York, NY, USA
180K-235K Annually
Expert/Leader
180K-235K Annually
Expert/Leader
Aerospace • Big Data • Fintech • Software • Analytics
Leads the design, development, testing, deployment, and architecture of production-grade LLM and agentic applications. Builds retrieval, tool-calling, orchestration, evaluation, guardrail, monitoring, and observability systems. Establishes AI-assisted development standards, reviews AI-generated code, mentors engineers, diagnoses model and prompt issues, and collaborates cross-functionally on AI strategy and product delivery.
Top Skills: Agent Orchestration FrameworksAgentic SystemsCi/CdClaude CodeCloud PlatformsContainerizationFunction CallingLlmopsLlmsMcpMlopsPrompt EngineeringRetrieval-Augmented Generation (Rag)Tool Calling

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account