Baseten Logo

Baseten

Forward Deployed SRE

Reposted 17 Days Ago
In-Office
2 Locations
150K-225K Annually
Mid level
In-Office
2 Locations
150K-225K Annually
Mid level
As an AI Support Engineer, you'll manage support requests, resolve user issues, optimize ML models, and contribute to product development.
The summary above was generated by AI

ABOUT BASETEN

Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $150M Series D, backed by investors including BOND, IVP, Spark Capital, Greylock, and Conviction. Join us and help build the platform engineers turn to to ship AI products.

THE ROLE

You will serve as the primary post-sales technical owner for our most strategic customers, ensuring smooth deployment, performance, and reliability of ML workloads in production. You’ll own the technical success and long-term outcome of our strategic and enterprise accounts by managing and resolving escalations, maintaining and improving our runbooks, and proactively surface patterns that drive product improvements. This role blends hands-on debugging, infrastructure expertise, AI model performance monitoring, and executive-level customer-facing ownership. You’re of course not alone in this endeavor — partnering closely with product, engineering, and forward-deployed teams to remove technical friction, drive adoption, and ensure long-term success for high-value accounts.

RESPONSIBILITIES

  • Diagnose and resolve runtime issues related to latency, memory behavior, GPU utilization, concurrency, and model lifecycle management.

  • Debug infrastructure issues across Kubernetes (pods, controllers), networking, observability, and alerting systems.

  • Lead incident response during outages or escalations, managing coordination between Product, FDE, Sales, and Engineering.

  • Serve as the technical owner for top enterprise accounts with strict SLAs and high responsiveness expectations.

  • Identify common failure modes and translate user feedback into roadmap signals, product improvements, our internal runbooks, knowledge bases, and diagnostic best practices.

  • Own project coordination end-to-end: scoping, execution, communication, and stakeholder alignment across technical and non-technical teams ranging from feature requests, new deployments, and operational debugging issues.

REQUIREMENTS

  • Deep Kubernetes troubleshooting expertise, including advanced resource debugging, pod/runtime analysis, and log-based diagnostics using observability tooling such as Grafana, Loki, and Prometheus.

  • Strong infrastructure debugging ability across container orchestration, networking, and service dependencies, with hands-on experience supporting production-grade clusters.

  • Experience managing high-severity incidents with major customers, including SLAs, post-incident reviews, and clear communication throughout escalations.

  • Proven project management and organizational skills with an ownership mindset, able to manage multiple complex, multi-stakeholder initiatives in parallel — including issue resolution, root-cause analysis, and feature delivery.

  • Ability to translate recurring technical pain points into roadmap-level insights, documentation improvements, or product enhancements.

  • Strong communication skills and executive presence during high-visibility situations, ensuring technical clarity and customer confidence.

  • 3+ years of experience in a fast-paced, high-growth, or customer-facing engineering environment.

BONUS

  • Familiarity with running high-performance AI models and workloads, including troubleshooting ML pipelines from preprocessing through inference and serving.

  • Experience implementing or managing ticketing and incident-response systems such as Zendesk or Pylon.

  • Familiarity with Helm, Flux, CI/CD tooling, or scripting automations to improve deployment, release, or operational workflows.

BENEFITS

  • Competitive compensation, including meaningful equity.

  • 100% coverage of medical, dental, and vision insurance for employee and dependents

  • Generous PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)

  • Paid parental leave

  • Company-facilitated 401(k)

  • Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.

At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.

Top Skills

Tensorrt

Similar Jobs

18 Days Ago
In-Office
2 Locations
150K-225K Annually
Senior level
150K-225K Annually
Senior level
Software
Lead a team of Support Engineers focused on AI Inference Infrastructure, managing incidents, optimizing performance, and improving operational practices.
Top Skills: AIGrafanaKubernetesLokiMlPrometheus
35 Minutes Ago
Hybrid
3 Locations
Senior level
Senior level
Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
Lead the design and implementation of complex patient support programs using Salesforce, collaborating with stakeholders to ensure alignment with business objectives while managing product backlogs and compliance.
Top Skills: Ai-Enabled ToolsAWSAzureDatabricksGCPPower BIRedshiftSalesforceSnowflake
38 Minutes Ago
Remote or Hybrid
New York, NY, USA
105K-120K Annually
Senior level
105K-120K Annually
Senior level
Productivity • Sales • Software
The Executive Assistant will provide high-level administrative support to the CRO, managing operations and ensuring effective communication within a fast-paced SaaS environment.
Top Skills: Google Workspace

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account