Baseten Logo

Baseten

Software Engineer, Cloud Platform

Posted Yesterday
Remote or Hybrid
Hiring Remotely in New York, NY, USA
165K-330K Annually
Entry level
Remote or Hybrid
Hiring Remotely in New York, NY, USA
165K-330K Annually
Entry level
Build and operate software, APIs, Kubernetes controllers, Terraform modules, and GitOps automation for production AI infrastructure. Responsibilities include managing multi-cloud Kubernetes fleets, automating cluster provisioning and upgrades, supporting GPU capacity, improving observability and reliability, and partnering with infrastructure teams from design through adoption.
The summary above was generated by AI

ABOUT BASETEN

Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.

THE ROLE

Join Cloud Platform Engineering to own the Kubernetes fleet that runs our production AI workloads. You’ll turn manual cluster operations into reliable, repeatable systems—from bringing new cloud providers online to rolling out configuration and upgrades safely across the entire fleet.

This is a hands-on software engineering role with ownership from design through production. You’ll build APIs, controllers, and automation that make infrastructure easier to operate, reduce configuration drift, and bring GPU capacity online seamlessly to power the AI inference business growth.

EXAMPLE INITIATIVES

  • Unify Kubernetes platform configuration under GitOps, replacing duplicated cluster manifests with shared configuration and explicit provider overrides.

  • Automate cluster onboarding and provisioning with reusable infrastructure templates, readiness checks, and recoverable workflows.

  • Build controllers and rollout mechanisms for fleet upgrades and workload-aware maintenance.

RESPONSIBILITIES

  • Design, build, and operate services, APIs, and Kubernetes controllers that automate cluster lifecycle management.

  • Develop reusable Terraform modules and GitOps configuration that work across cloud and GPU infrastructure providers.

  • Make infrastructure changes safe through validation, staged rollouts, clear ownership boundaries, and tested recovery paths.

  • Build observability into automation so engineers can understand progress, diagnose failures, and retry operations safely.

  • Partner with infrastructure and workload teams to define platform interfaces, resolve operational pain points, and take projects from design through adoption.

REQUIREMENTS

  • Experience building and owning production infrastructure software or distributed systems.

  • Strong programming skills in Go or another systems or backend language, with the ability to contribute to a Go codebase.

  • Deep experience with Kubernetes infrastructure, including developing controllers or operators and understanding reconciliation, custom resources, and failure handling.

  • Practical experience with infrastructure as code and GitOps tools such as Terraform and Flux or Argo CD.

  • Strong Linux, networking, and debugging fundamentals, with sound judgment about reliability and the impact of production changes.

  • Ability to turn ambiguous operational problems into maintainable software and communicate design tradeoffs clearly.

NICE TO HAVE

  • Experience managing Kubernetes fleets across multiple clouds or GPU infrastructure providers.

  • Contributions to Kubernetes or infrastructure open source projects, or experience with workflow orchestration and progressive delivery.

BENEFITS

  • Competitive compensation, including meaningful equity

  • (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents

  • Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)

  • Paid parental leave

  • Fertility and family-building stipend through Carrot

  • (U.S. only) Company-facilitated 401(k)

  • Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.

At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.

We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).

Baseten New York, New York, USA Office

New York, NY, United States

Similar Jobs

2 Months Ago
Remote
Senior level
Senior level
Artificial Intelligence • Cloud • Legal Tech • Software • Generative AI
Own the architecture, scalability, security, reliability, and technical direction of critical AWS-based platform domains. Design distributed, event-driven backend services, data models, APIs, multi-tenant systems, and AI/ML infrastructure. Lead cross-team initiatives from design through release, establish engineering standards, mentor engineers, improve observability and delivery practices, and guide modernization while maintaining product quality and cost efficiency.
Top Skills: Ai/MlAWSCi/CdInfrastructure As CodeJavaPython
5 Hours Ago
Easy Apply
Remote or Hybrid
Easy Apply
82K-105K Annually
Entry level
82K-105K Annually
Entry level
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Generate and qualify enterprise sales opportunities for Samsara’s SaaS products by conducting approximately 50 daily cold calls, mapping accounts, engaging executives, and building product demand. The role requires resilience, curiosity, collaboration, and the ability to learn technical concepts and use AI in daily workflows. Successful representatives may advance to closing sales roles within two years.
Top Skills: Artificial Intelligence (Ai)Internet Of Things (Iot)Linkedin Sales NavigatorSalesforceZoominfo
5 Hours Ago
Remote or Hybrid
CA, USA
185K-327K Annually
Senior level
185K-327K Annually
Senior level
Blockchain • Fintech • Mobile • Payments • Software • Financial Services
Build and operate database and storage platform software, including services, APIs, and developer tools for provisioning, migrations, upgrades, and lifecycle management. Solve scaling, performance, reliability, and data correctness challenges across databases, distributed systems, cloud infrastructure, and networking. Partner with engineering teams on schemas and platform adoption, lead technical projects through rollout, participate in on-call response, and use AI-assisted tools in development.
Top Skills: Ai-Assisted Engineering ToolsAmazon ElasticacheAPIsAWSAws AuroraBackend ServicesDynamoDBGoJavaKubernetesMySQLObservability ToolingOpensearchRedisRubyVitess

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account