Fireworks AI Logo

Fireworks AI

AI Product Engineer

Posted Yesterday
In-Office or Remote
2 Locations
200K-350K Annually
Mid level
In-Office or Remote
2 Locations
200K-350K Annually
Mid level
Build and own developer-facing product features for an LLM inference and fine-tuning platform, spanning frontend (console, playground), backend services, APIs, deployment, billing, and instrumentation. Ship end-to-end features, collaborate with cross-functional teams, and iterate rapidly based on usage data.
The summary above was generated by AI
About Us:

At Fireworks, we’re building the future of generative AI infrastructure. Our platform delivers the highest-quality models with the fastest and most scalable inference in the industry. We’ve been independently benchmarked as the leader in LLM inference speed and are driving cutting-edge innovation through projects like our own function calling and multimodal models. Fireworks is a Series C company valued at $4 billion and backed by top investors including Benchmark, Sequoia, Lightspeed, Index, and Evantic. We’re an ambitious, collaborative team of builders, founded by veterans of Meta PyTorch and Google Vertex AI.

About the Role

Product engineers at Fireworks build the software we ship to our users. You'll join a high-autonomy team that turns frontier AI infrastructure into products developers and enterprises love — from the inference API and developer console to fine-tuning workflows, deployment management, billing, and new bets like Fire Pass and agentic tooling.

This is not a "take a ticket and implement" role. You'll sit close to customers, talk to users directly, and iterate on what you ship based on real feedback — often within days, not quarters. You'll own features end-to-end: understand the problem (sometimes by joining a customer call), design the solution, build it across the stack, ship it, instrument it, and improve it until it works in production.

Fireworks owns the full stack: training, fine-tuning (SFT and RFT at frontier scale), serverless and dedicated inference, multi-LoRA serving, and agentic orchestration — all on infrastructure we built from scratch. Product Engineering sits on top of that stack and makes it usable. The pace of AI moves week to week; the map is being drawn as we go, and product engineers here help draw it.

You may be a fit if:

  • You've built a product people actually use — and you cared about how it felt, not just whether it compiled
  • You blend strong engineering with product taste and an instinct for what great developer experience looks like
  • You'd rather talk to a customer, ship a prototype, and learn than wait for a perfect spec
  • You have a knack for making powerful infrastructure feel simple — without dumbing it down
  • You move fast with good judgment: you know when to polish and when to ship and iterate

__________________________________________________

What You'll Do
  • Ship product and talk to users. Join customer calls, work with design partners, and turn what you learn into product improvements — not slide decks
  • Own features end-to-end across the Fireworks platform: developer console, API surfaces, model playground, fine-tuning workflows, deployment management, billing, and new product bets
  • Sprint on 0→1 initiatives. Take ambiguous ideas from concept to shipped product in weeks — new workflows, new product surfaces, new ways for developers to build on Fireworks
  • Build for deeply technical users where the product is an API as much as a UI — and sweat the details in both
  • Work full stack across frontend (React/TypeScript), backend services (Python, Go), APIs, and data layers to deliver polished, production-quality surfaces
  • Iterate with data and conviction. Instrument what you ship, watch how developers use it, run experiments, and improve fast
  • Partner across the company with Infrastructure, Applied Research, Growth, Data, and Design — but don't wait for perfect alignment to make progress
  • Punch through technical walls. When platform primitives aren't there yet, you'll help define what's needed and build around (or through) the gaps

__________________________________________________

Sample Projects
  • Launching a new developer workflow end-to-end in a two-week sprint — from customer problem to shipped console + API surface
  • Redesigning a core product flow (deployments, fine-tuning, or billing) after sitting in on customer onboarding sessions
  • Building and iterating on agentic product surfaces — tool use, orchestration UX, and harness tooling that developers trust
  • Running experiments on API/console behavior to reduce time-to-first-successful-request for new developers
  • Shipping a new consumption model or product vertical from scratch with a small cross-functional pod

__________________________________________________

Minimum Qualifications
  • 3+ years of experience as a software engineer, with meaningful time spent building user-facing products
  • Strong full-stack skills — comfortable across frontend (React/TypeScript), backend (Python, Go, or similar), APIs, and databases
  • Experience building developer-facing products: APIs, dashboards, consoles, CLIs, or developer tools
  • Track record of owning features end-to-end — from problem discovery through deployment and iteration
  • Strong product instincts and developer empathy — you notice when something is off in a workflow and you fix it
  • Demonstrated ability to operate at high velocity with extreme ownership: you ship fast, make pragmatic trade-offs, and don't wait to be told what to build
  • Comfort talking to customers and incorporating feedback directly into what you build

__________________________________________________

Preferred Qualifications
  • Experience at a fast-moving startup, applied AI company, or developer tools company — you know what "ship and learn" feels like at pace
  • Experience building products on top of complex infrastructure — inference platforms, cloud services, data platforms, or ML tooling
  • Independent product judgment — you can make sound decisions without heavy process or sign-off
  • UX and design obsession: you care about micro-interactions, empty states, error messages, and latency because magical developer products are built from hundreds of small decisions done right
  • You build with AI tools daily and have strong intuition for what great AI developer experience looks like from the inside
  • Experience working with enterprise customers or design partners — polished enough for a demo, gritty enough to debug in production

Total compensation for this role also includes meaningful equity in a fast-growing startup, along with a competitive salary and comprehensive benefits package. Base salary is determined by a range of factors including individual qualifications, experience, skills, interview performance, market data, and work location. The listed salary range is intended as a guideline and may be adjusted.

Base Pay Range (Plus Equity)
$200,000$350,000 USD
Why Fireworks AI?
  • Solve Hard Problems: Tackle challenges at the forefront of AI infrastructure, from low-latency inference to scalable model serving.
  • Build What’s Next: Work with bleeding-edge technology that impacts how businesses and developers harness AI globally.
  • Ownership & Impact: Join a fast-growing, passionate team where your work directly shapes the future of AI—no bureaucracy, just results.
  • Learn from the Best: Collaborate with world-class engineers and AI researchers who thrive on curiosity and innovation.

Fireworks AI is an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all innovators.

Similar Jobs

Yesterday
In-Office or Remote
Georgia, USA
2K-3K Annually
Senior level
2K-3K Annually
Senior level
AdTech • eCommerce • Marketing Tech • Retail
Founding AI Engineer responsible for end-to-end R&D and deployment of AI systems (LLMs, diffusion, vision), building rapid prototypes, orchestrating multi-model agentic workflows, integrating diverse APIs, and shipping scalable web applications to support e-commerce and future SaaS products.
Top Skills: ClaudeComfyuiControlnetCrewaiDiffusersFalFastapiGpt CodexIp-AdaptersLangchainNext.JsPythonReplicateReplitRunpod
2 Days Ago
In-Office or Remote
200K-250K Annually
Senior level
200K-250K Annually
Senior level
Software
Lead API product direction for search and retrieval primitives, partner with strategic accounts to architect integrations, translate customer insights into product specs and roadmaps, run technical deep-dives and documentation, and prototype and ship production code to improve developer experience and platform reliability.
Top Skills: APIsLlmsRetrieval SystemsSearch Infrastructure
12 Days Ago
Remote
United States
130K-208K Annually
Senior level
130K-208K Annually
Senior level
Database • Analytics
Build and ship production agents and reusable skills on a petabyte-scale observability platform. Own end-to-end agent stack (context engineering, tooling, MCP servers, SDKs, integrations), improve agent observability, evaluate models, and optimize for latency, cost, and reliability while collaborating openly with OSS contributors and customers.
Top Skills: ClickhouseColumnar DatabasesDockerEvent Ingestion PipelinesGoKubernetesLlmsMcpNode.jsOpentelemetryPythonRustSQLTypescript

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account