Fuse Energy Logo

Fuse Energy

AI Inference Engineer

Reposted 2 Months Ago
In-Office or Remote
Hiring Remotely in United States
Mid level
In-Office or Remote
Hiring Remotely in United States
Mid level
Define and build Fuse's inference-serving architecture and stack, including request routing, batching, scheduling, and autoscaling for latency-sensitive workloads. Own model-level optimizations (quantisation, distillation, speculative decoding), translate performance SLAs into capacity plans, and integrate low-level GPU/CUDA performance work with serving infrastructure. Set benchmarks, tooling, and act as technical owner of inference performance and reliability.
The summary above was generated by AI

Fuse Energy is an energy startup on a mission to make energy abundant and affordable, fast. We combine first-principles thinking with cutting-edge technology to build a radically better energy system.

We've raised over $200M from top-tier investors including Balderton, Lakestar, Accel, Creandum, Lowercarbon, Ribbit, 20VC, Hummingbird and Collaborative Fund, alongside strategic angels including Nico Rosberg and GPs behind Meta, Revolut, Spotify and Uber.

We're building a fully integrated energy company: developing our own solar, batteries and other generation projects, building our own hardware, improving and developing grid infrastructure, trading power in real time, using AI across the business, and installing distributed energy in homes. By selling directly to consumers we cut out the middleman, lower costs and pass the savings on to our customers.

As data centres become one of the largest and fastest-growing sources of electricity demand, Fuse is expanding into high-performance compute infrastructure at the intersection of energy and AI. We're building the GPU/CUDA performance layer and the inference serving layer at the same time, from scratch, and we're looking for the founding engineer to own the latter. Reporting directly to the CTO, you'll own the layer above kernels and hardware: how models actually get served, scaled and delivered against committed performance targets. Few companies can pair real power delivery with real compute the way Fuse can, which puts inference serving at the heart of our offering.

Responsibilities
  • Define Fuse's inference serving strategy and architecture from first principles
  • Design and build the serving stack: request routing, batching, scheduling and autoscaling for high-throughput, latency-sensitive inference workloads
  • Own model-level optimisation strategy for serving, deciding where and how to apply quantisation, distillation, speculative decoding and similar techniques to improve throughput and cost per token, partnering with the CUDA/GPU engineers
  • Make the core software architecture calls on serving frameworks and orchestration (e.g. vLLM, TensorRT-LLM, SGLang, Triton Inference Server or equivalents)
  • Translate throughput, latency and uptime commitments into concrete technical specifications and serving capacity plans
  • Act as direct technical owner of inference performance and reliability
  • Work closely with the CUDA and GPU engineering teams to integrate custom kernels and hardware performance work cleanly into the serving layer
  • Set the standards, tooling and benchmarks this function will run on as it grows

Requirements
  • 4+ years building or operating large-scale inference serving systems, or equivalent strong project/industry experience
  • Deep, hands-on experience with inference serving frameworks and the techniques used to optimise them (batching, KV-cache management, quantisation, speculative decoding)
  • Strong systems thinking, able to reason about the full path from incoming request to served response across a large cluster
  • Comfortable working directly with GPU/CUDA engineers to integrate low-level performance work into a serving system
  • A track record of making high-stakes architecture calls and owning the outcome
  • Comfort operating without a playbook: this is a founding role shaping a new function, not joining an established one
  • Bonus: Triton or custom ML inference/training frameworks; autoscaling or capacity planning for large-scale inference; multi-tenant serving or SLA-driven infrastructure; background at a hyperscaler, frontier AI lab or large-scale distributed inference system; Kubernetes/Slurm; interest in energy markets, grid systems or sustainability-focused compute

Benefits
  • Competitive salary and eligibility for equity
  • Biannual bonus scheme
  • Fully expensed tech to match your needs
  • Private health insurance
  • Breakfast and dinner allowance for office-based employees

As we hire globally, benefits vary by location.

Fuse Energy New York, New York, USA Office

New York, New York, United States

Similar Jobs

6 Days Ago
In-Office or Remote
3 Locations
152K-242K Annually
Senior level
152K-242K Annually
Senior level
Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
Develop compiler optimization algorithms for deep learning networks and AI inference platforms. Collaborate with software framework and GPU architecture teams to improve performance, build times, memory usage, APIs, and compiler techniques for current and future NVIDIA GPUs. Analyze performance, implement and test compiler technologies, support CPU/GPU workloads, and independently lead development efforts.
Top Skills: CC++CpuCudaGpuJaxLlvmMlirNsight ComputeOpenclPythonPyTorchTritonXla
14 Days Ago
In-Office or Remote
Senior level
Senior level
Artificial Intelligence • Cloud • Software
Own production inference for large language models across single and multi-node GPU systems. Select and tune precision, quantization, parallelism, memory strategies, batching, concurrency, topology, and serving runtimes. Benchmark and validate latency, throughput, utilization, and cost; operate model lifecycles and resolve incidents across runtimes, GPUs, hosts, drivers, and networks. Build software that automates deployment decisions and captures inference expertise for reliable multi-tenant and dedicated serving.
Top Skills: Amd GpusDistributed InferenceGpu NetworkingLinuxNvidia GpusPythonSglangTensorrt-LlmVllm
21 Days Ago
Remote
Georgia, USA
Mid level
Mid level
Cloud • Information Technology • Consulting
Designs and maintains secure GitLab CI/CD pipelines, automates vulnerability scanning, hardens and signs Docker images, enforces software supply chain security policies, and secures Kubernetes workloads. The role investigates vulnerabilities, manages Linux security and system hardening, and supports compliance with open-source licensing and security standards. Responsibilities include container security, image optimization, dependency checks, Kubernetes configuration security, and automated remediation across the AI inference platform.
Top Skills: Admission ControllersAlpineAnsibleBashChainguardContainer RegistriesCosignDependabotDistrolessDockerFalcoGitlab Ci/CdGrypeHelmKube-BenchKubernetesKubescapeKyvernoLinuxNetworkpoliciesOpa GatekeeperPod Security StandardsPythonRbacRenovateSbomsSigstoreSlsaTerraformTrivy

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account