Infrastructure operations · shared across customers
Reports to: Director, Network Engineering
Location: Remote (US) or Pleasanton, CA (hybrid)
Department: Infrastructure & DC Operations / Network Engineering
Position summaryThe Senior Network Engineer designs, deploys, and operates the high-performance networking fabric supporting GPU clusters. This includes InfiniBand and RoCE fabrics for training workloads, customer-facing connectivity, and the wide-area network that connects STN sites and customer environments.
Key responsibilities• Design and configure InfiniBand or RoCE fabrics optimized for GPU training and distributed inference
• Configure and operate switching, routing, and customer VLAN/VRF/VPC architectures
• Manage BGP peering, public IP space, anycast, and DDoS protection
• Design customer connectivity including cross-connects, dedicated links, VPN, and SD-WAN
• Maintain network automation, configuration management, and source-of-truth tooling
• Coordinate with the NOC on network monitoring, alerting, and runbook authoring
• Troubleshoot complex network issues across layers 1 through 7
• Maintain network documentation, diagrams, and operational runbooks
• Drive network capacity planning aligned to fleet growth and customer commitments
• Support security and compliance audits including SOC 2 and customer security reviews
Required qualifications• 7+ years in network engineering with data center or service provider experience
• Deep expertise in InfiniBand or RoCE (RoCEv2), including congestion control and NCCL tuning
• Strong knowledge of BGP, OSPF, MPLS, VXLAN, and EVPN
• Hands-on experience with Arista, NVIDIA Mellanox/Spectrum, or Cisco platforms
• CCIE, JNCIE, NCIE, or equivalent advanced certification strongly preferred
Preferred qualifications• GPU cluster networking experience at multi-thousand-GPU scale
• SDN and automation skills (Ansible, Python, Nautobot, or Netbox)
• Multi-site WAN and peering experience including IX participation
Familiarity with NVIDIA Cumulus, SONiC, or open networking stacks
Similar Jobs
What you need to know about the NYC Tech Scene
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
