Distyl AI Logo

Distyl AI

AI Engineer

Reposted 25 Days Ago
Hybrid
New York, NY, USA
150K-250K Annually
Junior
Hybrid
New York, NY, USA
150K-250K Annually
Junior
Design, build, deploy, and operate production AI systems for customers. Implement end-to-end AI workflows (models, prompts, agents, retrieval, evaluators), write maintainable Python services, monitor and debug live systems, create evaluation and observability tooling, and work closely with stakeholders to iterate systems for reliability and business value.
The summary above was generated by AI
About Distyl AI

Distyl is an applied AI technology company partnering with the world’s most ambitious institutions to rearchitect critical operations for the frontier of AI. Our customers include the largest companies in telecom, healthcare, insurance, manufacturing, consumer goods, and global social organizations.
We research and deploy technologies that power AI-native operations — both for our partners and for Distyl itself. Our work spans research into self-constructing systems, the development of the most reliable execution of AI systems, and products that transform mission-critical workflows. As a result, Distyl's technologies affect some of the world's largest operations — from hundreds of millions of consumer interactions to tens of millions of supply chain transactions and millions of patient journeys.
Distyl is backed by leading investors including Lightspeed Venture Partners, Khosla Ventures, Coatue, DST Global, and the board-members of 20+ F500s.

What We Are Looking For

AI Engineers build and operate production AI systems that deliver business value inside customer environments. This role is for engineers who thrive in ambiguous problem spaces, take ownership of outcomes, and want to work directly on AI systems that must perform reliably under enterprise constraints.

AI Engineers are hands-on builders. They design, implement, deploy, and iterate on end-to-end AI systems in close partnership with customers, subject matter experts, and other Distyl engineers. They translate messy operational needs into concrete system behavior, build the software and AI workflows required to support that behavior, and continuously improve systems through evaluation, feedback, integration, and production iteration.

This is not a demo-building role. AI Engineers are expected to make AI systems work in practice: with users, data, constraints, and accountability for production outcomes.

Key Responsibilities
  • Build and operate AI systems deployed in customer environments, taking ownership of system behavior, reliability, and usefulness in production

  • Design and implement compound AI workflows that combine models, prompts, agents, tools, retrieval, evaluation, feedback loops, and execution into coherent production systems aligned with user and SME needs

  • Develop clean, maintainable Python services and application logic that integrate AI capabilities into customer workflows, data platforms, APIs, and existing applications

  • Operate on live systems by measuring behavior, identifying failure modes, debugging issues, and iterating rapidly to improve quality, reliability, and user value

  • Build evaluation frameworks, test cases, feedback mechanisms, and observability patterns that help teams understand and improve AI system performance over time

  • Work directly with customer stakeholders and subject matter experts to understand workflows, clarify requirements, reason about tradeoffs, and adapt systems as needs evolve

  • Use AI-native engineering tools to accelerate implementation, debugging, experimentation, data analysis, and system improvement

  • Collaborate with other AI Engineers, AI Strategists, and other Distillers to make pragmatic system design decisions that balance speed, robustness, maintainability, and customer impact

  • Take accountability for the production outcomes of the components, workflows, and systems you build

What We Require
  • 5+ years of software engineering experience

  • Ownership mentality for AI systems. You take responsibility for whether the systems you build deliver their intended value in production. You are comfortable making technical decisions, learning from system behavior, and owning the results of your work

  • Experience building AI systems. You have built applications powered by LLMs or other AI models and are comfortable composing multiple components — prompts, agents, tools, retrieval, evaluators, workflows, and integrations — into end-to-end systems. You reason about system behavior holistically rather than treating models as black boxes

  • Strong engineering fundamentals. You write clean, maintainable Python and are comfortable building production software systems. You understand core engineering concepts like versioning, debugging, testing, performance, code review, and production readiness

  • AI-native working style. You use AI tools daily to write and debug code, explore designs, analyze data, and automate repetitive work. You are curious about new model capabilities and techniques, and actively incorporate them into how you build and iterate on systems

  • Comfort in customer environments. You are able to work directly with customer teams, ask good questions, and adapt quickly to new domains. You communicate clearly about system behavior, limitations, and tradeoffs, and can operate effectively in high-trust, high-visibility situations

  • Pragmatic delivery mindset. You can navigate ambiguity, make progress with incomplete information, and balance speed with robustness when building systems that need to work for production users

  • Willingness to travel. Travel is typically 10–30%, depending on the project, customer needs, and your role on the engagement

What We Offer
  • The base salary range for this role is $150K – $250K, depending on experience, location, and level. In addition to base compensation, this role is eligible for meaningful equity, along with a comprehensive benefits package

  • 100% coverage of medical, dental, and vision insurance for employee and dependents

  • Flexible time off

  • Retirement and financial planning benefits, including access to pre-tax HSA, FSA, and commuter accounts, 401(k), and financial coaching resources

  • Comprehensive wellness benefits, including physical fitness, mental well-being, and fertility and family-building benefits through Carrot

  • Complimentary in-office lunches and snacks provided

  • Access to state-of-the-art AI models, generous usage of modern AI tools, and real-world business problems

  • Ownership of high-impact projects across top enterprises

  • A mission-driven, fast-moving culture that values curiosity, pragmatism, and excellence

Distyl has offices in San Francisco and New York. This role follows a hybrid collaboration model with 3+ days per week (Tuesday–Thursday) in‑office.

#LI-Hybrid

We believe diverse perspectives make our work stronger and more impactful. We are an equal opportunity employer and evaluate all applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, disability, veteran status, or any other legally protected characteristic. We encourage candidates from all backgrounds to apply.

Similar Jobs

2 Days Ago
Hybrid
New York, NY, USA
245K-335K Annually
Senior level
245K-335K Annually
Senior level
Fintech • Machine Learning • Payments • Software • Financial Services
Lead the strategy, architecture, and implementation of Capital One’s enterprise developer insights and AI telemetry platform. Build high-throughput streaming data systems, ML/AI inference pipelines, and real-time analytics that measure developer productivity and AI impact. Establish privacy, security, and governance controls while correlating telemetry with business outcomes. Provide technical leadership through hands-on prototyping, architecture decisions, mentoring, and executive-level influence across engineering and analytics teams.
Top Skills: AWSClickhouseGoGCPJavaKafkaKinesisLlmAzureOpentelemetryProtobufPythonSnowflakeSparkTypescript
2 Days Ago
Hybrid
New York, NY, USA
197K-246K Annually
Senior level
197K-246K Annually
Senior level
Fintech • Machine Learning • Payments • Software • Financial Services
Lead development of scalable, responsible AI platform services, including foundation model training, LLM inference, similarity search, guardrails, evaluation, governance, and observability. Optimize AI training and inference for scalability, cost, latency, throughput, and hardware utilization. Partner with engineers, scientists, technical program managers, and product managers to deliver production AI systems and shape the long-term technical roadmap.
Top Skills: AWSAws UltraclustersAzureC#C++Foundation ModelsGoGCPHugging FaceJavaLarge Language ModelsNemo GuardrailsPythonPyTorchScalaSimilarity SearchVectordbs
2 Days Ago
Hybrid
New York, NY, USA
162K-201K Annually
Senior level
162K-201K Annually
Senior level
Fintech • Machine Learning • Payments • Software • Financial Services
Design, develop, deploy, and support foundational AI systems, including model training, LLM inference, similarity search, guardrails, evaluation, governance, and observability. Optimize large-scale AI systems for scalability, cost, latency, throughput, and hardware utilization. Collaborate with engineers, research scientists, technical program managers, and product managers to deliver responsible AI-powered products and shape the long-term roadmap for foundational AI platforms.
Top Skills: AWSAws UltraclustersAzureC#C++GoGCPHugging FaceJavaLarge Language ModelsMachine LearningNemo GuardrailsPythonPyTorchScalaSimilarity SearchVectordbs

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account