d-Matrix Logo

d-Matrix

Senior Infrastructure Engineer

Posted 22 Days Ago
Remote
Hiring Remotely in USA
98K-150K Annually
Senior level
Remote
Hiring Remotely in USA
98K-150K Annually
Senior level
Owns production infrastructure across Kubernetes, CI/CD, Linux systems, virtual machines, and AI accelerator environments. Responsibilities include incident response, troubleshooting, automation, monitoring, alerting, patching, upgrades, certificate renewals, capacity checks, runbook development, and on-call support. The engineer collaborates across IT and product software teams and contributes to infrastructure design and build work.
The summary above was generated by AI

Join d-Matrix and help build the future of AI inference. We’ve pioneered a memory-centric architecture that brings compute directly into memory, making AI faster, more energy efficient, and accessible on a global scale. From chips and software to rack-scale systems, our team is tackling some of AI infrastructure’s hardest challenges — and shipping breakthrough technology today. If you want to create what comes next and help make infinite inference possible, we’d love to hear from you.

Our culture is built on respect, collaboration, and direct communication. We value humility, we believe our different perspectives lead to better solutions, and we’re looking for people who are driven by execution and energized by hard problems.

Senior Infrastructure Engineer
Location: Remote, United States

Role Overview

Software Infrastructure runs the Kubernetes clusters, CI/CD systems, and compute environments that every d-Matrix engineer builds and tests on, along with the systems behind our externally accessible product demos. As a senior infrastructure engineer, you will be the team’s first responder and own issues end to end: diagnosing them, fixing them, and engaging IT or the product software group when the root cause sits with them. Our environment combines cloud resources, conventional servers, and our own AI accelerators and networking hardware, so quickly isolating the cause is central to the job. When an issue recurs, you will turn it into automation, better alerting, or a runbook. This is not an IT support or ticket-queue role, and IT owns physical hardware; we manage everything from the operating system up. On-call participation is expected.

What You Will Do

  • Own first response and resolution for issues across Kubernetes clusters, GitLab and CI runners, VMs, standalone systems, and demo environments

  • Triage across teams with IT and the product software group when the root cause sits on their side

  • Convert recurring issues into automation, alerts, and runbooks so repeat incidents decline

  • Improve monitoring and alerting to reduce false alarms and speed detection of real problems

  • Perform routine operational work, including upgrades, patching, certificate renewals, and capacity checks

  • Ship automation and improvements the team relies on, beyond individual fixes

  • Participate in on-call coverage for the environment

  • Contribute to design and build work across the team’s systems as your scope grows

What You Will Bring

  • 2+ years operating production Linux systems, including hands-on Kubernetes troubleshooting

  • Methodical debugging skills: forming hypotheses, narrowing them quickly, and working across layers when the obvious answer is wrong

  • Scripting experience in Python and/or Bash

  • Familiarity with CI/CD systems (GitLab preferred)

  • Working knowledge of networking fundamentals, including DNS, routing, load balancing, and TLS

  • Experience with monitoring and observability tools

  • Clear communication under pressure, including concise incident status updates

  • Drive and curiosity to learn unfamiliar systems and how state-of-the-art inference systems are built

Preferred Qualifications

  • Experience with GPU or accelerator nodes in Kubernetes

  • Experience with infrastructure-as-code tools such as Ansible or Terraform

  • Experience with monitoring platforms such as DataDog, Prometheus, or Grafana

  • Bare metal or on-prem infrastructure experience

  • CKA or CKAD certification

Equal Opportunity Employment Policy

d-Matrix is proud to be an equal opportunity workplace and affirmative action employer. We’re committed to fostering an inclusive environment where everyone feels welcomed and empowered to do their best work. We hire the best talent for our teams, regardless of race, religion, color, age, disability, sex, gender identity, sexual orientation, ancestry, genetic information, marital status, national origin, political affiliation, or veteran status. Our focus is on hiring teammates with humble expertise, kindness, dedication, and a willingness to embrace challenges and learn together every day.

d-Matrix does not accept resumes or candidate submissions from external agencies. We appreciate the interest and effort of recruitment firms, but we kindly request that individuals interested in opportunities with d-Matrix apply directly through our official channels. This approach allows us to streamline our hiring processes and maintain a consistent and fair evaluation of all applicants. Thank you for your understanding and cooperation.

Similar Jobs

2 Days Ago
Remote or Hybrid
OH, USA
Senior level
Senior level
Financial Services
Leads enterprise Network Access Control infrastructure engineering, including architecture, discovery, classification, control policy creation, phased enforcement, integrations, and operational ownership. Implements and modernizes complex network platforms while meeting compliance, risk, security, resiliency, and auditability requirements. Uses and validates AI-assisted engineering practices, drives automation and reuse, resolves complex infrastructure issues, and provides technical thought leadership. Requires expertise with ForeScout/CounterACT, NAC integrations, Python or Ansible, and preferably Cisco ISE, 802.1X, and pxGrid.
Top Skills: 802.1XAnsibleCisco IseCounteractForescoutNetwork Access Control (Nac)PxgridPython
8 Days Ago
Remote or Hybrid
Brooklyn, NY, USA
165K-250K Annually
Senior level
165K-250K Annually
Senior level
Cloud • Digital Media • News + Entertainment • On-Demand
Build and operate Philo’s ML and LLM infrastructure, including AWS and Kubernetes platforms, GPU scheduling, model serving, inference optimization, monitoring, evaluation, experimentation, and CI/CD. The role establishes infrastructure best practices, reliability, security, scalability, and Infrastructure as Code while supporting recommendation, video classification, and agent workloads. It also involves collaborating with engineers and vendors to deploy, instrument, and manage production systems.
Top Skills: AirflowAlbAmazon BedrockAnthropicAWSC++CloudFormationCloudwatchDagsterDatadogDnsDockerDvcElasticacheElbElkFeastFluentdGitlabGoGrafanaHTTPIamInfluxdbJavaScriptJenkinsKubeflowKubernetesLakefsLinuxLitellmMetaflowMlflowNlbNvidia TritonOpenaiPgvectorPineconePrometheusPythonRagRayRdsRoute 53RubySqsTcp/IpTectonTensorrt-LlmTerraformTgiTickTypescriptVllmVpcWeaviateWeights & Biases
16 Days Ago
Remote
United States
174K-261K Annually
Senior level
174K-261K Annually
Senior level
Artificial Intelligence • Productivity • Software • Automation
Secure Zapier’s production infrastructure by identifying and mitigating risks, hardening cloud environments, improving Terraform and CI/CD security, managing vulnerability and misconfiguration tools, enforcing least-privilege access, strengthening data governance, hardening Kubernetes images, and supporting incident response. The role collaborates with Platform, Engineering, and Security teams in a remote-first environment.
Top Skills: AWSCi/CdCloudFormationDockerGoInfrastructure-As-CodeJavaScriptKubernetesPythonTerraformWiz

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account