Top Infrastructure Engineer Jobs in NYC, NY

Designs, maintains, and supports secure, highly available IT infrastructure, including servers, networks, Microsoft platforms, backups, and software deployment systems. Provides third-line helpdesk escalation, technical guidance, infrastructure project delivery, documentation, and continuous improvement. The role minimizes downtime and business risk, supports disaster recovery issues, and advises on infrastructure solutions aligned with business requirements. Hybrid work is required for candidates near New York City or Greenbelt, Maryland.

Lead critical infrastructure platform initiatives enabling engineering teams to build, deploy, and operate products consistently. Responsibilities include developing multi-account and multi-region Kubernetes clusters, MLOps capabilities, standardized deployment systems, and company-wide authentication. The role also involves automating engineering workflows, improving developer experience, prioritizing shared platform initiatives with stakeholders, driving platform adoption, and mentoring team members.

Own Savvy’s AWS and EKS cloud platform, including cluster architecture, networking, IAM, infrastructure as code, CI/CD, observability, costs, and deployment standards. Operate PostgreSQL, Redis, and background job systems in production, improving reliability, incident response, upgrades, failover, and capacity. Build internal platform tooling, support infrastructure for coding agents and LLM workloads, audit inherited systems, and mentor engineers. The role sets long-term technical direction while enabling product engineers to ship safely and efficiently.

Design, build, and operate Polymarket’s Kubernetes-based infrastructure across cloud environments. Own scalability, reliability, disaster recovery, infrastructure automation, CI/CD, observability, incident response, and cloud optimization. Write production-grade code and infrastructure as code while collaborating with backend, exchange, and product engineering teams to support high-volume, low-latency systems.

Operates and improves secure, highly available infrastructure across RHEL, Windows, Azure, and multi-cloud environments. Responsibilities include server and network installation, maintenance, monitoring, troubleshooting, patching, automation, middleware support, security, disaster recovery, vendor coordination, documentation, and on-call support. The role also leads technical projects, mentors junior staff, supports development environments, manages asset lifecycles, and participates in infrastructure planning and optimization.

Build and maintain production infrastructure platforms (Rubix, Apollo, environment PaaS, observability) across fleets and clusters. Own full product lifecycle, collaborate with cross-functional teams, deploy secure solutions for civil and defense customers, and participate in field exercises to validate deployments.

Internship building shared infrastructure for Palantir platforms (backend, developer, frontend, or storage). Work across the product lifecycle to improve developer productivity, scalability, and reliability, collaborate with technical and non-technical partners, and be paired with a mentor.

Contribute code across production infrastructure platforms (Rubix, Apollo, environment PaaS, observability) while owning feature lifecycle, collaborating with cross-functional teams, and learning from a dedicated mentor. May support deployments in sensitive civil and defense contexts.

Build shared infrastructure for Palantir platforms (Foundry, Gotham, Apollo) across backend, developer, frontend, and storage domains. Improve developer productivity, scalability, and reliability; participate in design, implementation, and rollout; collaborate with technical and non-technical stakeholders while paired with a mentor to grow engineering impact.

Operate and improve large-scale NVIDIA GPU clusters across bare-metal and rented capacity. Build automation for provisioning, health checks, remediation, monitoring, scheduling, and capacity management. Own Linux images, drivers, CUDA, containers, networking, storage, and Slurm. Diagnose performance and hardware issues, evaluate GPU providers, support ML training workloads, and maintain secure infrastructure. The role also includes hardware installation, datacenter coordination, and vendor management.

Install, deploy, and support HPC infrastructure in customer data centers nationwide. Rack, stack, cable, configure, and troubleshoot servers, storage, networking, and GPU/HPC clusters. Perform Linux system administration, power and cabling work, hardware diagnostics and replacement, post-install testing, backups, and documentation. Operate material handling equipment, follow safety guidelines, and work independently at secure government/customer sites.

Lead platform engineering for high-scale, multi-region AWS payment infrastructure. Architect immutable, highly available, self-healing systems; automate infrastructure through Terraform, GitOps, CI/CD, and Kubernetes; establish observability with Prometheus, Grafana, and OpenTelemetry; own incident management and resiliency improvements; design private connectivity; and mentor engineers while driving organization-wide platform standards.

Build and operate a secure Kubernetes-based AI/ML platform for government test and evaluation teams. Responsibilities include GPU scheduling, workload orchestration, infrastructure-as-code, GitOps, observability, capacity planning, upgrades, security hardening, compliance support, and operational documentation. The role involves restricted and disconnected environments, automated security tooling, collaboration with government and engineering stakeholders, technical leadership, and mentoring.

Lead design, deployment, and operation of Caldera's blockchain infrastructure. Build and expand DevOps pipelines, manage Kubernetes/AWS deployments, implement IaC (Terraform/Helm), enhance observability, optimize performance, and maintain infrastructure security for production rollup chains.

As a Senior/Staff Infrastructure Engineer, you will architect and manage cloud-based infrastructure, maintain API systems, and resolve complex technical issues while fostering high-quality engineering practices.

The Infrastructure Engineer will design and develop scalable infrastructure and developer tools for KB AI. Responsibilities include setting technical direction and participating in company culture building.

Lead the architecture, scaling, reliability, and security of multi-region AWS infrastructure supporting high-throughput payment systems. Build immutable, self-healing environments with Terraform, Kubernetes, GitOps, CI/CD, and automated resiliency. Develop observability using Prometheus, Grafana, and OpenTelemetry; manage incidents and post-mortems; improve engineering velocity through Golden Paths and platform enablement; and mentor engineering teams on reliable infrastructure practices.

The Senior Software Engineer will architect and evolve a multi-tenant data model, design scalable backend services, and drive decision-making for data-layer performance, ensuring scalability and reliability for enterprise customers.

As a Senior Backend Software Engineer, you'll design, build, and operate scalable infrastructure systems, contributing to complex data processing libraries and distributed systems, while collaborating with teams to create impactful software solutions.

Backend Software Engineers at Palantir build scalable software solutions, focusing on data systems and infrastructure while collaborating with teams. Responsibilities include building performant systems, designing APIs, and automating deployment for distributed systems.

The role involves developing and maintaining high-performance model serving infrastructure, deploying AI models, and ensuring reliability in production systems across various environments.

As a Senior Software Engineer, you will enhance Palantir's Kubernetes networking infrastructure, design APIs, and drive infrastructure strategy while ensuring scalability and security.

The Backend Software Engineer will build scalable systems and APIs, work with various programming languages, and enhance the performance of large-scale data systems at Palantir.

The Staff Software Engineer will design and implement the backend architecture for Marimo's molab, focusing on high availability, low latency, and system stability, while utilizing CoreWeave's infrastructure.

Design, implement, maintain, and optimize hybrid public and private cloud infrastructure, storage, operating systems, enterprise management tools, and automation. Lead capacity planning, infrastructure cost analysis, security compliance, business continuity and disaster recovery planning, performance testing, documentation, and resolution of complex operational issues. Provide escalation support across technology departments while improving reliability, efficiency, and security.