Catapult Logo

Catapult

Agentic AI Engineer

Posted 11 Days Ago
In-Office
New York, NY, USA
107K-215K Annually
Senior level
In-Office
New York, NY, USA
107K-215K Annually
Senior level
Design and ship reliable production agentic AI systems for sports performance. Build multi-agent orchestration, persistent memory, tool use, confidence calibration, human-in-the-loop escalation, evaluation harnesses, observability, and regression testing. Collaborate with sport scientists and domain experts to create grounded, traceable, actionable recommendations that appropriately defer to humans. Requires strong Python, software engineering, production operations, and hands-on experience with agentic AI, multi-agent systems, and probabilistic model calibration.
The summary above was generated by AI

Catapult is building the future of sports performance technology.

Since 2006, we’ve helped more than 5,000 teams use data, science and technology to improve athlete health, readiness and performance. Our customers include teams across the NFL, NBA, NHL, MLS, EPL, AFL, NRL, NCAA and many more.

Now we're building the next layer of that platform: AI that can reason across everything we know about an athlete and turn it into intelligence a coach or performance practitioner can trust.

We're looking for an Agentic AI Engineer who has already shipped production AI systems and understands what it takes to make them reliable, measurable and trustworthy.


What you'll do:

  • Design and ship specialist AI agents that use memory, tools, data and multi-step reasoning.
  • Build multi-agent orchestration that routes work between specialist agents, manages dependencies and synthesises conflicting outputs.
  • Develop systems that evaluate confidence, uncertainty and consequence before recommendations reach a practitioner.
  • Build human-in-the-loop escalation so the system knows when to answer, when to ask for more information and when to defer to a human.
  • Create workflows that turn sport scientist expertise into validated, versioned and testable agent capabilities.
  • Build evaluation, observability and regression testing so agent performance can be measured and improved in production.
  • Work with domain experts to ensure AI outputs are grounded, traceable and actionable.

The goal is simple: multiple specialist agents working together to answer complex performance questions with a recommendation that is fast, grounded and calibrated.

What you need:

This is a senior engineering role. Three technical capabilities are essential.

1. Production agentic AI

You have personally shipped a production agentic AI system used by real users.

You have hands-on experience with:

  • Memory or persistent state
  • Tool use or tool calling
  • Multi-step reasoning or workflows
  • Production deployment and operation

Chatbots, prompt engineering and RAG alone are not enough.

2. Multi-agent orchestration

You have built or substantially contributed to a production multi-agent system.

You understand:

  • Agent routing and orchestration
  • Specialist agent composition
  • Dependency-aware workflows
  • Parallel and sequential execution
  • Conflicting agent outputs
  • Response synthesis

Experience with LangGraph, AutoGen, CrewAI or equivalent frameworks is valuable.

3. Confidence calibration

You have hands-on experience calibrating probabilistic ML or AI systems.

You should be comfortable with:

  • Platt scaling
  • Isotonic regression
  • Expected Calibration Error (ECE)
  • Reliability and calibration curves
  • Confidence and uncertainty estimation

We care about the difference between a model that sounds confident and a system with measurably calibrated confidence.


You should also have:

  • 5+ years of professional experience in applied ML, AI or software engineering
  • Strong Python
  • Strong software engineering fundamentals
  • Experience building and operating production systems

Experience with:

  • Production RAG and reranking
  • Foundation-model fine-tuning or domain adaptation
  • LoRA, PEFT or similar techniques
  • LLM observability and drift detection
  • Evaluation harnesses and automated regression testing
  • Human-in-the-loop architectures
  • Confidence thresholds and escalation models
  • Causal or counterfactual reasoning
  • Go/Golang
  • AWS, including ECS, EC2, Lambda, SNS or SQS
  • GraphQL, REST or gRPC
  • PostgreSQL or MongoDB

Experience working with sport scientists, clinicians or other domain experts is a plus.

You don't need to be a sports scientist, but familiarity with workload, readiness, recovery, biomechanics or athlete performance data will help.


What success looks like:

You'll help build a platform where specialist agents can investigate complex performance questions, use the right evidence, assess their uncertainty and produce a recommendation that a practitioner can understand and trust.

Most importantly, the system will know when not to answer.

Every recommendation should be:

Grounded. Calibrated. Traceable. Escalation-aware.

The practitioner remains responsible for the decision. Your job is to make that decision better informed, faster and more defensible.


Before you apply:

If you can demonstrate all three of the following, we'd like to hear from you:

  1. Production agentic AI
  2. Production multi-agent orchestration
  3. Hands-on confidence calibration

We don't expect every candidate to have every preferred skill. If you have the core experience and are excited by the problem, please apply.


Compensation & Benefits

The target Total Compensation range for this position is $107,250 - $214,500 per year. This range is inclusive of base salary and a target incentive plan (which may include equity, commission, or other bonus structures).

Your specific compensation within this range will be determined by factors such as your geographic location, relevant experience, and job-related skills.

In addition to this compensation, Catapult also offers generous paid leave and recognized company holidays, and the opportunity to participate in our comprehensive benefits package, including Health, Dental, and Vision insurance, and 401(k) retirement plan with company match.


Whether you’re interested in sports or not, you’ll have the satisfaction of knowing your work is supporting some of the most successful teams and athletes on the planet! 

Research shows that while men apply for jobs when they meet an average of 60% of the criteria, women and other marginalized groups tend only to apply when they check every box. So if you have what it takes, but don't meet every single point in our job ad, please still get in touch! We would love to have a chat and see if you could be a great addition to our team. We are building the future of sports performance. Our priority is to find the brightest talent who can add to our team culture, actively contribute, and be excited about what they do.


All offers of employment are subject to Catapult's positive prehire check. To find out more, please contact the Talent Partner for this role.

Similar Jobs

Yesterday
Hybrid
New York, NY, USA
197K-246K Annually
Senior level
197K-246K Annually
Senior level
Fintech • Machine Learning • Payments • Software • Financial Services
Lead the design, development, deployment, and support of foundational AI systems, including LLM inference, model training, similarity search, guardrails, evaluation, governance, and observability. Optimize production AI systems for scalability, cost, latency, throughput, and hardware utilization. Partner with engineers, scientists, program managers, and product managers while shaping the technical vision and roadmap for responsible AI platforms.
Top Skills: AWSAws UltraclustersAzureC#C++GoGCPHugging FaceJavaLarge Language ModelsNemo GuardrailsPythonPyTorchScalaSimilarity SearchVectordbs
2 Days Ago
Hybrid
New York, NY, USA
230K-286K Annually
Senior level
230K-286K Annually
Senior level
Fintech • Machine Learning • Payments • Software • Financial Services
Design, develop, deploy, and support foundational AI platform components, including LLM inference, model training, similarity search, guardrails, evaluation, governance, and observability. Optimize large-scale AI systems for scalability, latency, throughput, hardware utilization, and cost. Contribute to long-term platform strategy, apply advanced AI research in production, and collaborate with engineers, scientists, program managers, and product leaders while mentoring teams.
Top Skills: AWSAws UltraclustersAzureC#C++GoGCPHugging FaceJavaLarge Language ModelsNemo GuardrailsPythonPyTorchScalaSimilarity SearchVector Databases
148K-211K Annually
Expert/Leader
Artificial Intelligence • Cloud • Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Leads an Agile Release Train delivering an agentic AI web application across product, engineering, AI/ML, architecture, security, QA, DevOps, and operations teams. Facilitates PI Planning, dependency and risk management, release readiness, production deployment, metrics, and continuous improvement. Coordinates AI experimentation and production delivery while addressing model reliability, safety, latency, cost, integrations, observability, and operational risks. Serves as the execution integrator between technical teams, product leadership, and enterprise stakeholders.
Top Skills: Agent OrchestrationAi AgentsAi Evaluation FrameworksAi ObservabilityAPIsAWSAzureCi/CdCloud PlatformsDatabasesDevOpsEnterprise Identity And SecurityEvent-Driven SystemsFeature FlagsGenerative AiGCPKanbanLarge Language Models (Llms)MicroservicesPrompt EngineeringRagResponsible AiSafeScrumSreTool/Function CallingVector SearchWeb Applications

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account