Top Tech Jobs & Startup Jobs in NYC, NY

Lead a hands-on engineering team to improve kernel-centric reliability of large AI compute clusters. Own technical vision, build diagnostic and debug tooling, collaborate with SW and HW teams to reduce downtime, speed failure analysis, and mentor engineers to deliver scalable, reliable production systems.

Implement and scale LLM training, fine-tuning, and post-training techniques (RL-based). Build evaluation and data pipelines, debug ML stack issues, optimize training/inference workflows, and ship maintainable ML infrastructure code.

Drive end-to-end ML model inference performance: build kernel- and system-level performance models, optimize kernel microcode and compiler algorithms, debug runtime performance on system and cluster, and develop tooling to visualize and analyze performance data from the Wafer Scale Engine and compute cluster.

Build, productionize, and optimize a GPU-based inference stack combining GPU prefill with Cerebras decode. Implement and operate model-serving APIs, vLLM/PyTorch/ROCm runtimes, deployment and reliability practices, performance profiling and optimization, cross-layer debugging, numerical validation, and benchmarking/infrastructure for production inference at scale.