Fluidstack Logo

Fluidstack

Network Engineer, Design & Engineering

Posted 3 Days Ago
In-Office
New York City, NY, USA
180K-300K Annually
Senior level
In-Office
New York City, NY, USA
180K-300K Annually
Senior level
Design end-to-end datacenter network architectures for AI training and inference: topology, IP/routing, RDMA/lossless fabrics, physical integration (rack, power, cabling), and comprehensive HLD/LLD documentation. Collaborate with hardware, operations, cabling, software, and validation teams to produce deployable, scalable, and performance-validated designs.
The summary above was generated by AI
About Fluidstack

We exist to make humanity more free. For most of human history, you farmed or you starved. Technology gave people more time for the things they wanted to do, instead of things they had to do. Powerful AI will be the biggest lever for human choice we've ever built - but only if models are aligned with what humanity actually wants. There are groups building AI who don't share these goals. Whoever deploys frontier compute infrastructure fastest will decide whether AI expands human freedom or shrinks it.

We're singularly focused on delivering 10 to 100s of GWs of compute faster than anyone else, rethinking every layer of the stack. We acquire power, design and build data centers, and operate them - with teams spanning hardware and software. Speed and scale are our key differentiators. Come be a part of building civilization-scale infrastructure for AI.


We hire people who care deeply about this problem space. If that is you, please apply!

About the Role

Fluidstack is seeking a Network Engineer, Design & Engineering to join our Network Engineering team. This is a design-ownership role: you will take customer requirements — GPU shape, workload profile, scale targets, tenancy model — and produce end-to-end network architectures that are deployable, validated, and optimized for AI training and inference workloads.

This is not a traditional network engineering role. You will own the full design problem space: reasoning through topology selection, rack layout implications, power and thermal constraints, cable plant feasibility, and fabric scaling — all the way from requirements intake through design documentation that deployment teams execute against. Each customer engagement may involve a different GPU platform, a different network topology, and a different set of physical constraints. You must be able to reason from first principles through novel design challenges rather than pattern-match to a single reference architecture.

You will work closely with cross-functional partners in Hardware, DC Operations, ICT/Structured Cabling, Software Engineering, and Validation to ensure your designs are not just technically sound but physically buildable and operationally sustainable. Success means producing network designs that deployment teams can execute without ambiguity, that scale to the customer’s target, and that meet performance requirements on the first turn-up.

Focus
  • End-to-End Network Design: Own the design lifecycle from customer requirements through deployable architecture. Produce topology designs, IP/addressing schemes, routing policy, and fabric configuration specifications for AI training and inference fabrics. Design front-end (out-of-band management, customer access), back-end (GPU-to-GPU training fabric), and storage network architectures.

  • Multi-Customer Architecture Adaptability: Design network architectures that adapt to different GPU platforms (NVIDIA, AMD, custom accelerators), server form factors, and workload profiles. Each customer engagement may require a different rack layout, power envelope, cable infrastructure approach, and fabric topology.

  • Physical Infrastructure Integration: Translate logical network designs into physical reality. Work cross functionally on rack elevation planning, power distribution constraints, structured cabling architecture (fiber trunk design, patch panel layouts, cable pathway routing), and cooling/airflow considerations that impact network equipment placement. Ensure designs are buildable within the physical constraints of each facility.

  • Design Documentation & Handover: Produce comprehensive design packages that enable deployment teams to execute independently. This includes High-Level Designs (HLDs), Low-Level Designs (LLDs), cutsheet specifications, bill of materials, cabling matrices, and design decision records. Your documentation is the contract between design intent and deployment execution.

  • RDMA & High-Performance Fabric Design: Design lossless Ethernet fabrics optimized for RDMA (RoCEv2) workloads including PFC configuration, ECN tuning, traffic class design, and congestion management. Understand the relationship between fabric topology, ECMP behavior, and collective communication patterns in distributed training workloads.

  • Cross-Functional Design Collaboration: Partner with Hardware Engineering on server/GPU platform integration, DC Operations on facility constraints and power planning, ICT on structured cabling feasibility and fiber budgets, Software Engineering on automation requirements and DCIM data modeling, and Validation teams on test plans and acceptance criteria. Your designs must satisfy constraints across all of these domains.

  • Design Review & Standards: Participate in and lead design review sessions. Contribute to the development of reference architectures, design standards, and reusable design patterns that accelerate future deployments. Challenge assumptions — both your own and others’ — to ensure designs are technically rigorous and operationally sound.

About You
  • Design-First Network Engineer: 5+ years of network engineering experience with a demonstrated focus on network design and architecture rather than purely operational roles. You’ve designed datacenter network fabrics from requirements through deployment — not just configured them. You can articulate why a design decision was made, what tradeoffs were considered, and what constraints drove the outcome.

  • Deep L1–L3 Expertise: Strong command of datacenter network fundamentals including CLOS/fat-tree topologies, BGP (eBGP underlay, iBGP/eBGP overlay), EVPN/VXLAN, IP addressing and subnetting at scale, and physical layer design (optics selection, fiber types, link budgets). You understand how L1 decisions cascade into L2/L3 behavior and design accordingly.

  • RDMA & AI Fabric Understanding: Working knowledge of RDMA network design (InfiniBand and/or RoCEv2), lossless Ethernet configuration (PFC, ECN, DCQCN), and the network performance requirements of distributed AI training workloads. You understand why fabric design decisions directly impact training job completion time.

  • GPU Cluster Architecture Exposure: Experience designing networks around specific GPU platforms (NVIDIA DGX/HGX, AMD MI-series, custom accelerator platforms). Understanding of how GPU topology, NVLink/NVSwitch architecture, and host networking configuration interact with fabric design.

  • Physical Infrastructure Fluency: Ability to reason about network design in the context of physical constraints. You’ve worked through rack layout planning, power budget allocation, structured cabling architecture, and equipment placement decisions. You don’t design networks in a vacuum — you understand that every logical decision has a physical consequence.

  • First Principles Thinker: You break complex design problems into fundamental components and reason through them systematically. When faced with a new GPU platform, an unfamiliar facility constraint, or a novel customer requirement, you decompose the problem rather than reaching for the nearest template. You challenge assumptions — including your own — and can defend your design decisions with rigorous reasoning.

  • Documentation Rigor: You produce design documentation that is clear, complete, and actionable. Your HLDs and LLDs enable deployment teams to execute without requiring you in the room. You see documentation as a design artifact, not an afterthought.

  • Cross-Functional Collaboration: Excellent at working across engineering disciplines. You communicate design intent clearly to non-network stakeholders (hardware, facilities, cabling) and incorporate their constraints into your designs. You earn trust through technical depth and follow-through.

Nice to Haves
  • Hyperscale or Large-Scale Design Background: Experience designing networks at hyperscale companies (Meta, Google, Microsoft, AWS) or large AI infrastructure providers. You’ve seen what disciplined design processes look like at scale and can adapt those patterns to a fast-growing startup.

  • Multi-Vendor Platform Experience: Deep familiarity with multiple network hardware platforms (Arista, Juniper, NVIDIA/Mellanox, Broadcom-based). Experience designing for specific platform capabilities and constraints, including ASIC-level considerations that impact fabric design.

  • Automation-Aware Design: Experience designing networks with automation in mind — consistent naming conventions, structured data models, templatable configurations. You may not write the automation yourself, but you design architectures that are automatable by default.

  • WAN & Interconnect Design: Experience with WAN topology design, DCI (Data Center Interconnect), optical transport, and backbone network architecture. Understanding of how campus/datacenter design connects to broader network infrastructure.

  • Startup Experience: You’ve built something from scratch before — ideally in a high-growth infrastructure or cloud company. You’re comfortable with rapid context switching, evolving requirements, and the intensity of early-stage company building.

Salary & Benefits
  • Competitive total compensation package (salary + equity).

  • Retirement or pension plan, in line with local norms.

  • Health, dental, and vision insurance.

  • Generous PTO policy, in line with local norms.

The base salary range for this position is $200,000 – $275,000 per year, depending on experience, skills, qualifications, and location. This range represents our good faith estimate of the compensation for this role at the time of posting. Total compensation may also include equity in the form of stock options.

We are committed to pay equity and transparency.

Fluidstack is an Equal Employment Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability and protected veterans’ status, or any other characteristic protected by law. Fluidstack will consider for employment qualified applicants with arrest and conviction records pursuant to applicable law.

You will receive a confirmation email once your application has successfully been accepted. If there is an error with your submission and you did not receive a confirmation email, please email [email protected] with your resume/CV, the role you've applied for, and the date you submitted your application-- someone from our recruiting team will be in touch.

Similar Jobs

20 Minutes Ago
In-Office or Remote
Jersey City, NJ, USA
163K-267K Annually
Expert/Leader
163K-267K Annually
Expert/Leader
Consumer Web • eCommerce • Machine Learning • Software • Sports • Analytics
Lead and scale People Operations for a global, multi-brand workforce of 3,000+ employees. Build HR systems, policies, compliance, and vendor ecosystems; drive automation and data-driven HR processes; partner on headcount planning, M&A integrations, global mobility, and lifecycle programs (onboarding, offboarding, talent acquisition ops). Manage a People Ops team and cross-functional projects to ensure consistent, compliant employee experiences across brands and geographies.
21 Minutes Ago
Remote or Hybrid
United States
207K-300K Annually
Mid level
207K-300K Annually
Mid level
Artificial Intelligence • Information Technology • Machine Learning • Natural Language Processing • Productivity • Software • Generative AI
Own the Coda Docs sales motion within an enterprise book: build pipeline, partner with ATU AEs, Sales Engineers and CSMs, run consultative discovery with VP/C-suite stakeholders, demo tailored Coda solutions, navigate procurement/legal, maintain Salesforce pipeline and forecasts, and contribute GTM playbook improvements to drive land and expansion revenue.
Top Skills: Coda DocsSalesforce
22 Minutes Ago
Easy Apply
Hybrid
Easy Apply
150K-160K Annually
Senior level
150K-160K Annually
Senior level
eCommerce • Fintech • Food • Mobile • Social Impact
Design, own, and evolve inKind's web and mobile testing platform and automation frameworks. Build CI/CD pipelines, test harnesses, and guardrails to improve reliability, performance, and developer experience. Partner with engineers and QA to define standards, scale infrastructure, and mentor teams on testing best practices.
Top Skills: AppiumAWSAzureCi/CdContainerized TestingCypressDockerEspressoGCPMobile Device FarmsPlaywrightRuby On RailsSeleniumXcui

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account