Decagon Logo

Decagon

Senior Software Engineer, Infrastructure

Posted 25 Days Ago
Be an Early Applicant
In-Office
New York City, NY
250K-330K Annually
Senior level
In-Office
New York City, NY
250K-330K Annually
Senior level
Design, build, and operate production infrastructure for high-scale, low-latency systems while ensuring high availability and optimizing performance.
The summary above was generated by AI

About Decagon

Decagon is the leading conversational AI platform empowering every brand to deliver concierge customer experience. Our AI agents provide intelligent, human-like responses across chat, email, and voice, resolving millions of customer inquiries across every language and at any time.

Since coming out of stealth, Decagon has experienced rapid growth. We partner with industry leaders like Hertz, Eventbrite, Duolingo, Oura, Bilt, Curology, and Samsara to redefine customer experience at scale. We've raised over $200M from Bain Capital Ventures, Accel, a16z, BOND Capital, A*, Elad Gil, and notable angels such as the founders of Box, Airtable, Rippling, Okta, Lattice, and Klaviyo.

We’re an in-office company, driven by a shared commitment to excellence and velocity. Our values—customers are everything, relentless momentum, winner’s mindset, and stronger together—shape how we work and grow as a team.

About the Team

The Infrastructure team builds and operates the foundations that power Decagon: networking, data, ML serving, developer platform, and real‑time voice. We partner closely with product, data, and ML to deliver high‑scale, low‑latency systems with clear SLOs and great developer ergonomics.

We organize around five focus areas:

  • Core Infra: The foundational cloud stack—networking, compute, storage, security, and infrastructure‑as‑code—to ensure reliability, scale, and cost efficiency.

  • Data Infra: Streaming/batch data platforms powering analytics/BI and customer‑facing telemetry, including for customer‑managed and on‑prem environments.

  • ML Infra: GPU and model‑serving platforms for LLM inference with multi‑provider routing and support for on‑prem/air‑gapped deployments.

  • Platform (DevEx): CI/CD, paved paths, and core services that make shipping fast, safe, and consistent across teams.

  • Voice Infra: Telephony/WebRTC stack and observability enabling ultra‑low‑latency, high‑quality voice experiences.

Our mission is to deliver magical support experiences — AI agents working alongside humans to resolve issues quickly and accurately.


About the Role

We’re hiring a Senior Infrastructure Engineer to design, build, and operate production infrastructure for high‑scale, low‑latency systems. You’ll own critical services end‑to‑end, improve reliability and performance, and create paved‑paths that let every Decagon engineer ship confidently.


In this role, you will
  • Design and implement critical infrastructure services with strong SLOs, clear runbooks, and actionable telemetry.

  • Partner with research and product teams to architect solutions, set up prototypes, evaluate performance, and scale new features.

  • Tune service latencies: optimize networking paths, apply smart caching/queuing, and tune CPU/memory/I/O for tight p95/p99s.

  • Evolve CI/CD, golden paths, and self‑service tooling to improve developer velocity and safety.

  • Support various deployment architectures for customers with robust observability and upgrade paths.

  • Lead infrastructure‑as‑code (Terraform) and GitOps practices; reduce drift with reusable modules and policy‑as‑code.

  • Participate in on‑call and drive down toil through automation and elimination of recurring issues.


Your background looks something like this
  • 6+ years building and operating production infrastructure at scale.

  • Depth in at least one area across Core/Data/AI‑ML/Platform/Voice, with curiosity to learn the rest.

  • Proven track record meeting high availability and low latency targets (owning SLOs, p95/p99, and load testing).

  • Excellent observability chops (OpenTelemetry, Prometheus/Grafana, Datadog) and incident response (PagerDuty, SLO/error budgets).

  • Clear written communication and the ability to turn ambiguous requirements into simple, reliable designs.


Even better
  • Experience being an early backend/platform/infrastructure engineer at another company

  • Strong Kubernetes experience (GKE/EKS/AKS) and experience across multiple cloud providers (GCP, AWS, and Azure)

  • Experience with customer‑managed deployments


Benefits
  • Medical, dental, and vision

  • Flexible time off

  • Daily lunch/dinner & snacks in the office

Top Skills

Aks
AWS
Azure
Datadog
Eks
GCP
Gke
Grafana
Kubernetes
Opentelemetry
Prometheus
Terraform

Similar Jobs

11 Days Ago
Hybrid
New York, NY, USA
150K-225K Annually
Senior level
150K-225K Annually
Senior level
Artificial Intelligence • Fintech • Machine Learning • Natural Language Processing • Software • Generative AI
As a Senior Software Engineer, you'll design backend components for Kensho's language models, build tools for engineering teams, and implement monitoring systems, requiring collaboration across teams and expertise in multiple programming languages.
Top Skills: Amazon EksAWSAzureC++GCPGoGrafanaPostgresPrometheusPythonRustTerraformUnix/Linux
11 Days Ago
In-Office
Latham, NY, USA
Senior level
Senior level
Information Technology • Software
The Senior Cloud Infrastructure & DevOps Engineer will manage Azure services, optimize hybrid infrastructure, oversee DevOps automation, and mentor junior engineers.
Top Skills: Argo CdAzureAzure DevopsBarracuda Load BalancerConsulDatadogElastic SearchExpressrouteHyper-VKubernetesOctopus DeployRabbitMQSplunkSQL ServerTerraform
19 Days Ago
In-Office
3 Locations
204K-259K Annually
Senior level
204K-259K Annually
Senior level
Automotive
Develop and deploy machine learning solutions, focusing on predictive planning and ensuring reliability of ML infrastructure in production settings.
Top Skills: Python,C++,Gcp,Aws,Kubernetes,Tf,Jax,Flax,Beam,Tf.Serving,Torchserve,Kubeflow,Sagemaker Pipelines,Vertex Ai Pipelines

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account