General Compute Logo

General Compute

Network Engineer

Posted 25 Days Ago
Hybrid
New York, NY, USA
Entry level
Hybrid
New York, NY, USA
Entry level
Design and own scalable data center networks for a heterogeneous AI inference fleet. Responsibilities include leaf-spine architecture, GPU-to-ASIC connectivity, site deployment, cabling, cross-connects, external connectivity, tenant isolation, automation, monitoring, incident response, and vendor management. The role requires hands-on network design and deployment across high-performance AI/HPC environments and close collaboration with platform engineering.
The summary above was generated by AI

About us

General Compute is the neocloud for alternative chips.

Inference is fragmenting: purpose-built silicon from SambaNova, Cerebras, Positron, d-Matrix, and others already beats GPUs on decode, and we productionize that hardware — we buy the racks, find the data center space, and run it for our customers. Each piece of hardware runs the workload it's actually built for: prefill stays on GPUs, decode moves to the chip built for it, and today that means generating tokens 5–7× faster than existing GPU-based competitors. Our customers are frontier labs, fast-growing AI application companies, and asset-light clouds.

We closed a $15M seed round in May 2026, and have since closed a $400M debt facility — $100M funded upfront by Upper90, with the balance available for drawdown — collateralized by our inference chips.

About the role

You will design and build the network our inference fleet runs on. Every rack we buy has to be racked, cabled, connected, and turned into capacity the platform can use. The network is what makes that happen. There's no existing network team, no inherited topology, and no reference architecture to copy. You'll build it right the first time, knowing it has to scale site after site.

The problem is also new. The fleet is heterogeneous by design. GPUs handle prefill, and decode runs on accelerators from several ASIC vendors, each with its own interconnect requirements and management tooling. You'll define how those systems connect to each other, to our customers, and to the internet. You'll do it as part of the Data Center Deployment team that stands up every new site.

What you'll do:

  • Design and own the data center network architecture: the leaf-spine fabric, the high-bandwidth, low-latency paths between GPU prefill and ASIC decode systems, and out-of-band management

  • Lead the network build-out for each new site: bill of materials, rack elevations and cabling plans, cross-connects, and bring-up through acceptance testing

  • Turn each accelerator vendor's networking requirements into one consistent fleet design

  • Set up external connectivity: IP transit, peering, and private connections to customers

  • Build tenant isolation and network security in from day one, not bolted on after the first enterprise customer asks

  • Automate configuration, provisioning, and validation against a real source of truth, so site five goes up faster than site one

  • Build monitoring and telemetry for the fabric, and own network incident response

  • Manage network hardware vendors, carriers, colocation providers, and remote-hands teams

  • Work at the boundary with the platform team. Own the physical and L2/L3 network, fabric performance, and site connectivity. Hand off to the Platform Engineer for fleet-wide request routing, model placement, and scheduling rather than owning that layer yourself

What we need from you:

  • Hands-on experience designing and deploying data center networks, not only operating existing ones

  • Deep routing and switching knowledge for modern DC fabrics: BGP, EVPN-VXLAN or equivalent, ECMP, leaf-spine design

  • Experience building high-performance networks for AI/HPC clusters or other latency-critical environments (RDMA/RoCE, InfiniBand, congestion control, 400G/800G optics)

  • Network automation skills (Python, Ansible, or similar) and comfort treating network config as code

  • Comfort on the data center floor: working through cabling, optics, and hardware failures yourself or by guiding remote hands

  • Comfort with hardware heterogeneity and ambiguity

  • Genuine interest in being an early hire at a ~6–7 person company

Nice-to-haves:

  • Networking experience with non-NVIDIA accelerators (SambaNova, Cerebras, TPU pods, or similar)

  • Multi-tenant cloud networking and tenant isolation at scale

  • Experience with transit contracts, peering, and internet exchanges

  • Network source-of-truth tooling (NetBox, Nautobot) and streaming telemetry (gNMI)

Similar Jobs

5 Days Ago
Remote or Hybrid
New York, NY, USA
75K-95K Annually
Mid level
75K-95K Annually
Mid level
AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
Build, deploy, configure, and support scalable network infrastructure for broadcast and media production facilities. Manage Cisco, Arista, Juniper, Palo Alto, and F5 technologies, including firewall policies, automation, monitoring, documentation, and troubleshooting. Support 24/7 production networks through on-call rotation and provide escalated issue resolution across multiple locations. Contribute to hybrid cloud networking, network security, and remote event support, with occasional travel required.
Top Skills: AnsibleAWSAzureCisco IosCisco Nx-OsCisco XrF5GitIpsecIs-IsJuniperL3VpnMp-BgpMplsMulticastOspfPalo AltoPanoramaPort-ChannelingQosSegment RoutingTraffic EngineeringVlanVpcVrf
4 Days Ago
Hybrid
New York, NY, USA
315K-392K Annually
Senior level
315K-392K Annually
Senior level
Fintech • Machine Learning • Payments • Software • Financial Services
Architect and build the Global Payment Network’s real-time and batch data infrastructure, including event-driven pipelines, canonical data models, metadata and catalog systems, streaming, storage, and low-latency services. Establish technical standards for scalable distributed systems, partner with fraud, analytics, modeling, product, and risk teams, and mentor engineers as a senior individual contributor without direct reports.
Top Skills: AWSFlinkGCPIcebergJavaScriptKafkaAzureSpa FrameworksTypescript
27 Days Ago
In-Office
New York City, NY, USA
173K-233K Annually
Senior level
173K-233K Annually
Senior level
Artificial Intelligence • Legal Tech • Software
Owns Legora’s multi-site corporate network, including Meraki, Tailscale, wired and wireless infrastructure, WAN, segmentation, DNS, DHCP, and firewall policy. Responsibilities include network architecture, monitoring, incident response, root-cause analysis, site installations, vendor and ISP management, automation, budget coordination, and Tier-2/Tier-3 escalation support. The role also establishes standardized network designs and leads upgrades through on-site technology teams and external vendors.
Top Skills: 1PasswordApple HardwareAuvikBgpCatchpointCiscoCisco MerakiDatadogDhcpDnsEkahauFirewallHaminaIpamItsmLanmacOSMeraki ApiMtlsNeatOktaPrtgPulumiQosSd-WanSnmpSyslogTailscaleTerraformThousandeyesVerkadaVlanWanWi-FiWiresharkZoomZtna

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account