EverOps Logo

EverOps

Senior DevOps Engineer (AI-Enabled Platform Engineering)

Posted 2 Days Ago
Remote
Hiring Remotely in USA
Senior level
Remote
Hiring Remotely in USA
Senior level
Build and operate highly available, cloud-native platforms supporting traditional and AI/ML workloads. Responsibilities include Kubernetes and EKS operations, infrastructure automation, GitOps, CI/CD, observability, production migrations, AI service integration, model-serving infrastructure, and AI-assisted operational tooling. The role also supports multi-tenant platforms, customer environments, incident response, cost optimization, and internal AI practice development.
The summary above was generated by AI
Senior DevOps Engineer

AI-Enabled Platform Engineering Focus

 
About EverOps

EverOps is the partner engineering teams wish they had but didn't know existed. We embed elite operators directly in our customers' teams to help them ship faster, reduce risk, and optimize cloud spend. We call them TechPods: forward-deployed, outcome-driven, backed by proven playbooks and AI-native workflows.

We sit in the sweet spot between strategy-only firms and staff-aug vendors. Not Big 4. Not bodies for hire. Operators who think big and deliver fast. Since 2012, companies like Coinbase, Snowflake, and Peloton have trusted us to scale platforms, cut waste, and modernize delivery.

We are an AWS Advanced Tier co-sell partner, and our go-to-market is increasingly AWS-led. Our thesis is sharp: make AI actually run in production on AWS, not in a slide deck. That is the work this role delivers.

EverOps has always been 100% remote. Our culture was built for a distributed team to thrive, and this role can be based anywhere in the United States.

 
The Challenge

EverOps is looking for a Senior DevOps Engineer who brings deep platform engineering expertise and an AI-native mindset to enterprise cloud infrastructure. This role lives at the intersection of traditional DevOps and the emerging AI platform layer—you’ll build and operate cloud-native platforms where AI/ML workloads are first-class citizens, integrate agentic tooling into delivery workflows, and help our clients operationalize AI capabilities within their existing infrastructure. You’ll manage projects autonomously, leverage strong communication and collaboration, and focus on client satisfaction and high availability.

 
The Mission

As a Senior DevOps Engineer at EverOps you will join our U.S.-Based Virtual Operating Center (your home office), working with a team of dynamic engineers to manage and evolve multiple customers’ production cloud environments. You’ll bring AI-native thinking to infrastructure automation—using AI-assisted development tools as standard delivery accelerators, designing platform patterns that support AI workloads alongside traditional services, and contributing to EverOps’ growing AI practice. Our existing team of engineers has a deep understanding of our customer environments and are eager to empower, ramp up, and mentor each new hire so that success is achieved.

 
What You’ll Do
  • Develop and use automation tools effectively to operate, manage, and scale production and development environments quickly

  • Design and operate platform infrastructure that supports both traditional and AI/ML workloads—model serving endpoints, inference scaling, GPU-aware scheduling, and managed AI service integration

  • Build AI-augmented operational tooling including agentic runbook execution, AI-assisted incident triage, and intelligent alerting pipelines

  • Use AI coding tools (Claude Code, GitHub Copilot) as standard delivery accelerators across infrastructure and automation work

  • Integrate managed AI services (AWS Bedrock, SageMaker, or equivalent) into client platform architectures, including vector store infrastructure and RAG-supporting patterns

  • Automate toil reduction using LLM-powered automation—generating IaC, synthesizing operational insights, and accelerating documentation workflows

  • Implement new tools and technologies as customer requirements evolve, with a focus on AI-readiness across the platform stack

  • Monitor environments while focusing on constant improvement, including observability for AI workloads (inference latency, model endpoint health, token throughput)

  • Support production workload migrations using blue-green and progressive delivery patterns

  • Contribute to multi-tenant Kubernetes platform operations and maintenance

  • Participate in regular customer and internal EverOps scrums

  • Contribute to internal AI practice development, client AI readiness assessments, and the evolution of EverOps’ agentic engineering methodology

 
You Have
  • 5+ years of professional experience as a DevOps, CloudOps, Platform, or Site Reliability Engineer

  • Hands-on experience and deep understanding of Linux

  • Strong hands-on professional experience with either Golang, Python, Ruby, Bash, Typescript, or Rust

  • Strong hands-on experience with Amazon Web Services, Google Cloud, or Azure designing, building, and running highly-available cloud-native environments

  • Production experience with Amazon EKS including multi-tenant cluster architecture, namespace isolation, and RBAC models

  • Experience deploying or operating AI/ML infrastructure—model serving endpoints, inference APIs, GPU instances, or managed AI services (Bedrock, SageMaker, or equivalent)

  • Familiarity with AI-assisted development workflows and agentic tooling (Claude Code, Copilot, or similar) as applied to infrastructure and automation work

  • Understanding of vector databases, retrieval-augmented generation (RAG) patterns, or LLM integration at the infrastructure level

  • Experience with ArgoCD for GitOps-driven deployments; federated ArgoCD experience a plus

  • Experience with HashiCorp Vault for secrets management, including integration with Kubernetes (External Secrets Operator or similar)

  • Understanding of GitOps workflows, repository structures, and governance patterns

  • Understanding of current best practices and principles related to Infrastructure as Code (Terraform + Atlantis and/or CloudFormation)

  • Experience with CI/CD tools like Jenkins, GitHub Actions, ArgoCD, Spinnaker, etc.

  • Familiarity and/or experience with containerization using Docker and Kubernetes (K8s)

  • Experience with monitoring tools such as Datadog, Splunk, ELK, Prometheus/Grafana

  • Experience with automation tools like Ansible, Chef, Packer, etc.

 
Extra Awesome
  • Experience with AWS Bedrock, AgentCore, or Strands Agents SDK for building agentic AI workloads

  • Experience building agentic workflows or AI-powered internal tooling (automated triage, intelligent escalation, self-healing infrastructure)

  • AI safety and governance awareness—guardrails, content filtering, prompt injection mitigation, or responsible AI operationalization

  • Platform engineering for multi-tenant AI workloads including isolation, cost attribution, and inference resource management

  • Argo Rollouts or similar progressive delivery tooling (canary, blue-green deployments)

  • FinOps experience including cost allocation, tagging strategies, and compute optimization for AI/GPU workloads

  • Gaming infrastructure or high-MAU consumer platform experience

  • Atmos (Terraform wrapper) experience

  • Platform consolidation or migration program experience

  • NoSQL experience with Cassandra, MongoDB, or DynamoDB

  • Relational database experience with MySQL or Postgres

  • Industry certifications (AWS AIF-C01, AWS Solutions Architect, Red Hat, HashiCorp, Google Cloud, etc.)

  • Strong desire to learn new technologies

  • Experience in SaaS companies and startup environments

 
Benefits
  • 100% remote workplace – We’ve been remote since Day 1!

  • Unlimited Paid Time Off

  • Equity – If you display ownership of the work you’re doing you’ll become a true owner of the company

  • 401K with company contribution

  • Company sponsored healthcare

  • Competitive compensation

  • Opportunities to accelerate professional growth with access to training and certification programs

Similar Jobs

An Hour Ago
Remote or Hybrid
California, USA
Senior level
Senior level
Consumer Web • eCommerce • Information Technology • Retail • Software • Analytics • App development
Leads state and local government affairs across Western markets, including policy monitoring, legislative analysis, advocacy strategy, lobbying, stakeholder engagement, and relationships with elected officials, trade associations, NGOs, and community groups. Partners with internal business functions to align public policy initiatives with enterprise priorities, directs lobbyists and consultants, and serves as a subject matter lead on retail policy issues. The role is based in Sacramento and requires travel up to 40%.
An Hour Ago
Remote or Hybrid
United States
71K-120K Annually
Mid level
71K-120K Annually
Mid level
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Analyzes operational data across payments, fraud, customer service, compliance, and processing to identify trends, anomalies, risks, control gaps, and process breakdowns. Develops predictive monitoring models, dashboards, and exception reports; leads root cause analysis; recommends corrective actions; and helps standardize control reporting for operations and leadership.
Top Skills: Power BIPython
An Hour Ago
Remote or Hybrid
United States
59K-99K Annually
Mid level
59K-99K Annually
Mid level
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Analyzes fraud cases, reviews documentation and account activity, makes audit-ready determinations, monitors fraud and operational risk trends, and develops control reporting. The role identifies control gaps, supports remediation, strengthens fraud oversight and governance, and partners with operations, risk, compliance, privacy, and investigations teams to improve mitigation processes.

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account