Runware Logo

Runware

Staff Software Engineer - Serverless

Reposted 3 Days Ago
Remote
Hiring Remotely in United States
Senior level
Remote
Hiring Remotely in United States
Senior level
Lead the development of Runware's serverless platform by building core systems for AI workload management and providing technical guidance to the team.
The summary above was generated by AI

We’re looking for a Staff/Senior Software Engineer to technically lead and build Runware’s serverless platform. You’ll be part of a small team working closely with senior leadership to bring a new product line to market.

Runware is evolving beyond model APIs into a platform where developers can deploy models and run AI workloads without managing GPUs, servers or infrastructure. You’ll build the software layer that connects our proprietary high-performance sonic inference engine and turns complex infrastructure into a compelling developer experience.

This is a role for someone who enjoys technical leadership, hard platform problems and clean, simple systems. Your work will help enterprises, model labs and developers move from idea to production faster, then scale without needing to build and operate the infrastructure themselves.

What you’ll do
  • Build the core systems behind Runware’s serverless platform, including workload execution, routing, scheduling, isolation and scaling leveraging our inference engine
  • Make it simple for developers to deploy models and run AI workloads without managing GPUs, servers, queues or infrastructure through a simple SDK interface
  • Design and improve the control plane for serverless execution, including APIs, workers, lifecycle management, retries and failure handling
  • Work closely with our infrastructure and ML teams to improve workload startup time, GPU utilisation, model warm-up, caching and placement
  • Build observability that makes serverless workloads easy to monitor, debug and operate at scale globally
  • Lead the technical design, mentor other engineers and help define the engineering standards for a new product area

Requirements
  • Strong experience as a Staff Engineer, Senior Software Engineer, Backend Engineer, Platform Engineer or similar
  • Experience building backend services, distributed systems, developer platforms or workload orchestration systems
  • Strong understanding of async processing, queues, scheduling, retries, back pressure and failure handling
  • Comfortable working across APIs, control planes, workers, databases and observability systems
  • Strong engineering fundamentals in one or more backend languages ideally Go
  • Good judgement around trade-offs between reliability, latency, scale, cost and developer experience
  • Clear communication, strong ownership and the ability to lead technical direction in a fast-moving environment
Nice to have
  • Experience building serverless platforms, job execution systems, container platforms or compute orchestration systems
  • Experience with GPU-backed workloads, AI/ML inference, model serving, batch processing or high-performance compute
  • Familiarity with technologies such as vLLM, TensorRT, Triton, Kubernetes, Nomad or Knative
  • Experience improving workload performance through batching, autoscaling, model warm-up, caching, request routing or queue management
  • Experience with multi-tenant isolation, sandboxing, quotas, rate limits, resource accounting or usage-based billing

Benefits

We’re a remote-first collective, meeting in person twice a year to plan, brainstorm, celebrate wins, and enjoy some face-to-face time. We have core hours for cooperative working and calls, but outside of that your calendar is yours. Work the hours that let you perform at your peak while also building a healthy life.

We move quickly and hold a high bar, but we also believe sustainable performance matters. After major releases and milestones, we create space for the team to properly unplug, recharge and come back with the energy to tackle what's next.

  • Generous paid time off – vacation, sick days, public holidays
  • Meaningful stock options – share in the upside you create
  • Remote-first setup – work from home anywhere we can employ you
  • Flexible hours – own your schedule outside core collaboration blocks
  • Family leave – paid maternity, paternity, and caregiver time
  • Company retreats – twice-yearly gatherings in inspiring locations

Similar Jobs

Yesterday
Remote
2 Locations
Senior level
Senior level
Artificial Intelligence • Consumer Web • Digital Media • Information Technology • Social Impact • Software
Lead the AI Quality engineering team while remaining hands-on building evaluation infrastructure, observability tooling, diagnostic systems, datasets, annotation workflows, and CI/CD pipelines for production AI agents. Run experiments across prompts, models, routing, caching, and agent harnesses to improve quality, latency, and cost. Partner with AI Core engineering and manage technical direction and team priorities.
Top Skills: Ai AgentsBraintrustCi/CdLangsmithLlmsPythonRuby On Rails
Yesterday
Remote or Hybrid
Senior level
Senior level
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Build and ship AI-native product capabilities, including models, tools, retrieval, and evaluation. Lead technical delivery for product areas, design and review code, partner with product owners, support CI/CD and production readiness, instrument features, improve shared engineering patterns, and mentor AI Product Engineers. The role requires strong software engineering fundamentals, production systems experience, and hands-on AI/ML or generative AI integration.
Top Skills: Ai/MlSparkAPIsCi/CdDistributed Web SystemsGenerative Ai
Yesterday
Easy Apply
Remote
Easy Apply
Senior level
Senior level
Cloud • Security • Software • Cybersecurity • Automation
Leads professional services engagement design, scoping, pricing, and pre-sales for complex DevSecOps and digital transformation implementations across EMEA. Builds executive relationships, conducts discovery, develops proposals, statements of work, staffing plans, and implementation roadmaps, and guides customers through procurement and contracting. Owns engagements from discovery through delivery transition, manages escalations, forecasts bookings, and tracks margin and customer outcomes while enabling sales and delivery teams.
Top Skills: Cloud ComputingDevsecopsGitlabSoftware Development Lifecycle (Sdlc)

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account