Top Tech Jobs & Startup Jobs in NYC, NY

Act as 'Customer Zero' for the internal ML research platform: benchmark and stress-test distributed training and inference stacks, enable rapid prototyping and agentic/auto-research workflows, identify system bottlenecks across hardware and software, document empirical findings, and advise engineering and research teams on platform improvements.

Design and build a zero-touch machine lifecycle pipeline: automate out-of-band firmware/BIOS management, network boot OS provisioning, Ansible-based configuration, CI/CD-driven GitOps reconciliation, automated validation/burn-in, lifecycle state machine, and instrumentation for fleet-scale datacenter operations.

Design, deploy, and operate large distributed GPU clusters. Profile and optimize GPU workloads across compute, storage, and network. Build automation for provisioning, monitoring, diagnostics, and self-healing. Qualify new hardware, partner with researchers and vendors, and own infrastructure projects end-to-end.

Design and optimize ultra-low-latency ML inference pipelines across CPUs, GPUs, and FPGAs. Benchmark heterogeneous platforms, develop high-performance GPU kernels, resolve memory and interconnect bottlenecks, and apply model reduction (quantization, pruning, distillation) to meet microsecond-level latency for production trading systems while collaborating with ML researchers, HPC, FPGA, and datacenter teams.

Build, operate, and improve software delivery and developer infrastructure for large-scale C++ and Python applications. Design and run CI/CD pipelines, build systems, artifact management, infrastructure automation, observability, containerized workflows, and developer self-service tooling. Partner with engineers, SRE, and global platform teams to improve performance, reliability, security, and developer productivity.

The role involves design and development of tools for enhancing developer productivity and infrastructure, automate workflows, and mentor team members while optimizing systems.

Conduct execution-quality research across global markets: model market impact and slippage, design A/B tests and causal analyses, build optimization and simulation tools, and deliver analytics and decision support to traders and PMs for improved order routing and execution.

As a Founding Engineer, you will drive the core product's engineering from the ground up, focusing on ML engineering in a startup environment.