Alignity Logo

Alignity

AI DevOps Engineer

Reposted One Month Ago
In-Office
New York, NY, USA
Mid level
In-Office
New York, NY, USA
Mid level
The AI DevOps Engineer will design, deploy, and manage scalable AI infrastructure, focusing on automation, security, and high performance while ensuring compliance within financial services.
The summary above was generated by AI
Do you love a career where you Experience, Grow & Contribute at the same time, while earning at least 10% above the market? If so, we are excited to have bumped onto you.

Learn how we are redefining the meaning of work, and be a part of the team raved by Clients, Job-seekers and Employees.
  • Jobseeker Video Testimonials 
  • Employee Glassdoor Reviews
If you are a Field Service Engineer looking for excitement, challenge and stability in your work, then you would be glad to come across this page.

We are an IT Solutions Integrator/Consulting Firm helping our clients hire the right professional for an exciting long-term project. Here are a few details.

Check if you are up for maximizing your earning/growth potential, leveraging our Disruptive Talent Solution.

Role:AI DevOps Engineer
Location: New York, NY 
Work Mode: (Hybrid – 3–4 Days Onsite per Week) 
Type: Contract
Industry: Financial Services


Requirements

About the Role

Our client is seeking a highly skilled AI DevOps Engineer to design, build, and operate scalable, secure, and production-grade infrastructure supporting modern AI platforms and LLM-powered applications.

This role sits at the intersection of DevOps, Platform Engineering, Site Reliability Engineering (SRE), and AI Infrastructure, enabling high-performance AI systems, agent-based workflows, and enterprise AI platforms within a regulated financial services environment.

The ideal candidate will have strong expertise in Kubernetes, Terraform, cloud infrastructure, automation, and AI platform operations, along with experience supporting modern AI/LLM workloads in production environments.


Key Responsibilities

  • Design, deploy, and manage scalable infrastructure for AI and LLM-based applications in production environments.
  • Build and maintain Infrastructure-as-Code (IaC) using tools such as Terraform for secure, repeatable, and auditable deployments.
  • Deploy, manage, and scale containerized environments using Kubernetes with a focus on high availability and reliability.
  • Implement DevOps, Platform Engineering, and SRE best practices to improve system reliability, scalability, and operational efficiency.
  • Support AI platform services for model serving, inference, experimentation, and evaluation workflows.
  • Deploy and maintain infrastructure supporting AI agents, orchestration frameworks, and LLM runtime dependencies.
  • Design and manage vector database infrastructure including Pinecone, Weaviate, or PostgreSQL with pgvector for RAG and semantic search use cases.
  • Enable AI developer platforms and tooling for engineering teams building AI-powered applications.
  • Implement monitoring, alerting, logging, and incident response processes for mission-critical AI systems.
  • Collaborate with security, compliance, and governance teams to ensure adherence to regulatory and enterprise security standards.
  • Continuously improve automation, developer experience, and operational processes for AI infrastructure environments.

Required Qualifications

  • Bachelor’s degree in Computer Science, Engineering, or equivalent practical experience.
  • Proven experience as a DevOps Engineer, Platform Engineer, or Site Reliability Engineer (SRE).
  • Strong hands-on experience managing large-scale production infrastructure.
  • Expertise with Terraform and Infrastructure-as-Code (IaC) methodologies.
  • Strong experience deploying and operating Kubernetes-based environments.
  • Experience supporting infrastructure for AI platforms or LLM-based applications.
  • Strong understanding of automation, scalability, reliability, and cloud-native architectures.

Preferred Qualifications

  • Experience supporting production-grade LLM applications and AI agent workloads.
  • Hands-on experience with vector databases such as Pinecone, Weaviate, or pgvector.
  • Experience building or supporting AI tooling and internal AI developer platforms.
  • Knowledge of observability, monitoring, capacity planning, and reliability engineering for AI/ML systems.
  • Experience working within financial services or other highly regulated industries.
  • Strong communication and cross-functional collaboration skills.


Benefits
Visit us at http://alignity.io/careers. Alignity Solutions is an Equal Opportunity Employer, M/F/V/D.

CEO Message: Click Here
Clients Testimonial: Click Here

Similar Jobs

21 Days Ago
Remote or Hybrid
2 Locations
150K-190K Annually
Senior level
150K-190K Annually
Senior level
Marketing Tech • Analytics
Designs, automates, and supports enterprise DevOps platforms across on-premises and hybrid cloud environments. Responsibilities include CI/CD, infrastructure as code, Linux administration, Kubernetes and container platforms, Azure and GCP operations, AI/ML infrastructure support, monitoring, reliability engineering, production support, security, disaster recovery, and cloud modernization. The role partners with infrastructure, development, security, architecture, and operations teams while participating in incident management and on-call rotations.
Top Skills: AksAnsibleAzure DevopsAzure MonitorBashDockerEksGenerative AiGkeGoogle Cloud Platform (Gcp)GrafanaJenkinsKubernetesLarge Language Models (Llms)LinuxAzureOpenshiftPowershellPrometheusPythonVector Databases
15 Minutes Ago
Easy Apply
Hybrid
New York, NY, USA
Easy Apply
85K-100K Annually
Junior
85K-100K Annually
Junior
eCommerce • Food • Pet
Lead planning and execution of regional brand activations across the Northeast: source venues, coordinate vendors/staffing, manage logistics and budgets, localize national campaigns, build partner relationships, serve as regional stakeholder contact, and provide on-site support (significant regional travel).
15 Minutes Ago
Easy Apply
Remote or Hybrid
United States
Easy Apply
Junior
Junior
eCommerce • Food • Pet
Lead planning and execution of regional brand activations across the Southeast: venue sourcing, vendor coordination, on-site logistics, budget management, partner relationships, localizing national campaigns, and serving as primary regional stakeholder contact while traveling frequently to support events.

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account