Top Infrastructure Engineer Jobs in NYC, NY

Manage and improve a large-scale Linux infrastructure across hardware, virtualization, containers, and operating systems. Responsibilities include developing automation, modifying Debian images, compiling custom kernels, monitoring systems, troubleshooting kernel-to-application performance issues, tuning for low latency, and managing the full lifecycle of Linux systems. The role requires Linux systems expertise, programming ability, distributed systems and networking knowledge, and experience operating hundreds to thousands of servers.

Own and scale Pallet’s infrastructure supporting millions of AI agent runs. Responsibilities include improving capacity, performance, reliability, cloud and on-prem portability, enterprise integrations, observability, incident response, developer productivity, CI, deployments, and production debugging. The role sets technical direction, establishes SLOs, plans capacity, identifies bottlenecks, and leads reliability improvements.

Build and maintain fault-tolerant Kubernetes infrastructure on bare metal, including automated control-plane provisioning, cluster lifecycle management, operators, testing, reliability improvements, and production support. Develop tooling with Python, Golang, and Bash; troubleshoot Linux and Kubernetes systems; use GitOps, Ansible, CI/CD, and Grafana; and participate in an on-call rotation.

Support production NVIDIA GPU infrastructure, including Kubernetes clusters and DGX components. Deploy, update, patch, and troubleshoot LLMs or other open-source models. Diagnose outages and maintain reliable infrastructure using DevOps practices and scripting.

Build and maintain secure, reusable Azure platform infrastructure using Terraform and programmatic IaC frameworks. Consult with engineering teams on cloud architecture, cost, security, and governance. Develop AI agents, MCP integrations, self-service tooling, CI/CD pipelines, observability solutions, and deployment automation. Drive compliance remediation across teams, manage scalable globally distributed systems, document technical concepts, and contribute to platform strategy and technical direction.

Own and architect secure AWS infrastructure for isolated, single-tenant, and air-gapped enterprise environments. Build repeatable Terraform deployments, security controls, observability, CI/CD pipelines, and containerized infrastructure. Partner with founders and customer security teams, lead incident response and on-call operations, and support regulated environments. The role also requires strong Python development and close collaboration with a London infrastructure team while establishing the company’s US infrastructure presence.

Build and maintain Terraform infrastructure supporting AWS environments, provision non-production environments for release testing, troubleshoot environment issues during release windows, align standards with Platform Reliability, and maintain auditable infrastructure documentation.

Build and operate highly available, scalable infrastructure for WRITER’s AI platform across AWS, GCP, and Azure. Lead reliability engineering, SRE, DevOps, incident response, post-mortems, and root-cause analysis. Automate infrastructure with Python or Go, manage Kubernetes, Helm, and Terraform, define SLOs and error budgets, improve observability and platform efficiency, and partner cross-functionally on resilient system design. The role also requires daily use of AI-assisted development and operations tooling.

Staff backend infrastructure engineer responsible for platform reliability, performance, regional resilience, failover, migrations, data pipelines, observability, incident response, and shared engineering tooling. The role leads cross-team technical direction, mentors engineers, and partners with security and compliance in a regulated financial services environment. Key technologies include Java, MongoDB, Kubernetes/GKE, Terraform, Datadog, and cloud infrastructure.

Own complex infrastructure incident investigations, escalations, migrations, upgrades, and root-cause remediation across multiple client environments. Administer Microsoft infrastructure, identity platforms, virtualization, networking, security, backup, and disaster recovery systems. Provide client-facing technical support, documentation, automation, and occasional onsite assistance in the New York metropolitan area. Work independently across varied technologies while maintaining accountability through resolution.

Build and maintain CrowdStrike’s golden-image platform and automated pipelines across Linux, macOS, and Windows. Develop Python automation for image builds, validation, drift detection, and testing; manage infrastructure as code with Ansible, Packer, and Terraform; integrate Jenkins, GitLab CI, and Artifactory; and support image lifecycle operations. The role includes troubleshooting production issues, security hardening, compliance collaboration, documentation, cross-team partnership, and participation in on-call rotations.

Own Harvey’s shared cloud-first IT infrastructure, infrastructure-as-code framework, automation, provisioning, monitoring, backups, resilience, certificates, DNS, and office technical standards. Build maintainable scripts, CI pipelines, and recovery runbooks while partnering with security, networking, and platform teams. Improve change control, documentation, and operational reliability across SaaS systems including Okta, Jamf, Intune, Google Workspace, and Microsoft 365.

Supports cloud infrastructure operations, deployments, monitoring, incident resolution, disaster recovery, backups, IAM governance, and Level 2 production support. Develops automation, monitoring, reporting, documentation, and cloud standards while troubleshooting production issues and participating in on-call rotations. Collaborates with platform teams, researches cloud-native technologies, improves reliability and cost efficiency, and supports secure distributed systems.

Leads global network infrastructure engineering across campus and WAN environments, with deep expertise in enterprise wireless design, deployment, troubleshooting, and performance optimization. Analyzes complex infrastructure issues, architects modernization initiatives, drives multiple programs, advises senior leaders, and ensures compliance, resiliency, security, and auditability. Promotes validated AI-assisted practices for infrastructure analysis, automation, documentation, and incident prevention.

Designs and operates scalable infrastructure for agentic AI, model training, inference, and distributed workloads. Responsibilities include Kubernetes and GPU platform engineering, infrastructure as code, high-performance storage and networking, observability, FinOps, security, capacity management, testing, documentation, and operational support. The role also integrates AI-assisted engineering and AIOps tools into deployment, monitoring, troubleshooting, and infrastructure workflows while partnering with AI, security, risk, and platform teams.

Oversee global data center network infrastructure operations, including deploying, repairing, installing, and decommissioning servers, storage systems, routers, switches, cabling, firmware, and software. Monitor and troubleshoot hardware, coordinate deployments and rack designs, manage inventory and shipping, support data center migrations and upgrades, and collaborate with Network Operations Centers and on-site technicians.

Leads telecommunications infrastructure design and delivery across structured cabling projects, managing requirements, drawings, specifications, budgets, contractors, testing, construction milestones, quality assurance, and project closeout. Collaborates with stakeholders, architects, general contractors, integrators, and engineering teams to deliver resilient, secure, auditable infrastructure solutions. Applies authorized AI tools to infrastructure analysis and documentation while validating outputs and protecting sensitive data. Domestic travel of approximately 20% is required.

Maintains secure, reliable, and highly available servers, networks, operating systems, middleware, and multi-cloud infrastructure. Responsibilities include installation, upgrades, monitoring, troubleshooting, automation, security patching, disaster recovery, job scheduling, vendor coordination, documentation, and 24x7 on-call support. The role also supports development, test, and production environments, leads infrastructure projects, mentors technical staff, and recommends improvements to infrastructure performance, security, and lifecycle management.

Implements and supports enterprise AI infrastructure platforms across client environments. Configures Kubernetes, workload schedulers, GPU resource governance, containers, observability, security, and related platform services. Performs discovery, deployment, integration, upgrades, troubleshooting, validation, documentation, and knowledge transfer. Collaborates with cross-functional technical teams, contributes to implementation plans and Statements of Work, manages project deliverables, and provides client-facing consulting support. Travel and occasional extended or weekend work may be required.

Own Pikkit’s cloud infrastructure, AI agent engineering harnesses, developer workflows, and security foundation. Build secure systems enabling agents to create pull requests, debug issues, and operate scoped staging and production environments. Improve developer experience from local development through production, remove delivery bottlenecks, and establish scalable operating standards for a small AI-enabled engineering team.

Design and scale Posh’s AWS cloud infrastructure for millions of users. Build infrastructure-as-code, CI/CD pipelines, observability, automation, and developer tooling; improve reliability, security, performance, and cost efficiency. Collaborate with engineering, data, security, and product teams, investigate scaling bottlenecks, and mentor engineers on infrastructure and secure deployment best practices.

Own and extend AWS-based infrastructure and backend platform systems with a focus on reliability, scalability, security, and automation. Build infrastructure as code, deployment pipelines, authentication, code search, sandboxed execution, and orchestration. Automate deployments across customer cloud and on-premises environments, troubleshoot VPN and network connectivity, support compliance initiatives, and improve AI-assisted developer workflows.

Designs, administers, migrates, secures, and troubleshoots Azure and on-premises infrastructure across cloud, servers, storage, networking, endpoints, virtualization, and directory services. The role supports Azure modernization, disaster recovery, cost and risk modeling, vulnerability remediation, infrastructure automation, technical documentation, and on-call operations. It also provides technical leadership, escalated issue resolution, staff training, and cross-team support for highly complex cloud environments.

Designs, administers, and troubleshoots Azure and on-premises infrastructure, including servers, storage, networks, virtualization, endpoints, and directory services. Leads cloud migrations, modernization, security compliance, disaster recovery, cost and risk modeling, automation, and complex cloud architecture. Provides technical leadership, escalated troubleshooting, documentation, staff training, and on-call support. The role requires after-hours and weekend work, travel, and expertise across Azure, Windows Server, Active Directory, Intune, SCCM, PowerShell, Ansible, and vulnerability remediation.

Own the reliability, security, availability, backups, disaster recovery, deployments, and hosting of Windows- and Linux-based production environments. Manage servers, networking, access controls, monitoring, vulnerability remediation, high availability, recovery testing, CI/CD support, infrastructure upgrades, and deployment automation. Evaluate cloud and hybrid-cloud modernization strategies while coordinating incidents, vendors, and technology lifecycle activities.