Alignity Logo

Alignity

AI DevOps Engineer

Reposted One Month Ago
In-Office
New York, NY, USA
Mid level
In-Office
New York, NY, USA
Mid level
The AI DevOps Engineer will design, deploy, and manage scalable AI infrastructure, focusing on automation, security, and high performance while ensuring compliance within financial services.
The summary above was generated by AI
Do you love a career where you Experience, Grow & Contribute at the same time, while earning at least 10% above the market? If so, we are excited to have bumped onto you.

Learn how we are redefining the meaning of work, and be a part of the team raved by Clients, Job-seekers and Employees.
  • Jobseeker Video Testimonials 
  • Employee Glassdoor Reviews
If you are a Field Service Engineer looking for excitement, challenge and stability in your work, then you would be glad to come across this page.

We are an IT Solutions Integrator/Consulting Firm helping our clients hire the right professional for an exciting long-term project. Here are a few details.

Check if you are up for maximizing your earning/growth potential, leveraging our Disruptive Talent Solution.

Role:AI DevOps Engineer
Location: New York, NY 
Work Mode: (Hybrid – 3–4 Days Onsite per Week) 
Type: Contract
Industry: Financial Services


Requirements

About the Role

Our client is seeking a highly skilled AI DevOps Engineer to design, build, and operate scalable, secure, and production-grade infrastructure supporting modern AI platforms and LLM-powered applications.

This role sits at the intersection of DevOps, Platform Engineering, Site Reliability Engineering (SRE), and AI Infrastructure, enabling high-performance AI systems, agent-based workflows, and enterprise AI platforms within a regulated financial services environment.

The ideal candidate will have strong expertise in Kubernetes, Terraform, cloud infrastructure, automation, and AI platform operations, along with experience supporting modern AI/LLM workloads in production environments.


Key Responsibilities

  • Design, deploy, and manage scalable infrastructure for AI and LLM-based applications in production environments.
  • Build and maintain Infrastructure-as-Code (IaC) using tools such as Terraform for secure, repeatable, and auditable deployments.
  • Deploy, manage, and scale containerized environments using Kubernetes with a focus on high availability and reliability.
  • Implement DevOps, Platform Engineering, and SRE best practices to improve system reliability, scalability, and operational efficiency.
  • Support AI platform services for model serving, inference, experimentation, and evaluation workflows.
  • Deploy and maintain infrastructure supporting AI agents, orchestration frameworks, and LLM runtime dependencies.
  • Design and manage vector database infrastructure including Pinecone, Weaviate, or PostgreSQL with pgvector for RAG and semantic search use cases.
  • Enable AI developer platforms and tooling for engineering teams building AI-powered applications.
  • Implement monitoring, alerting, logging, and incident response processes for mission-critical AI systems.
  • Collaborate with security, compliance, and governance teams to ensure adherence to regulatory and enterprise security standards.
  • Continuously improve automation, developer experience, and operational processes for AI infrastructure environments.

Required Qualifications

  • Bachelor’s degree in Computer Science, Engineering, or equivalent practical experience.
  • Proven experience as a DevOps Engineer, Platform Engineer, or Site Reliability Engineer (SRE).
  • Strong hands-on experience managing large-scale production infrastructure.
  • Expertise with Terraform and Infrastructure-as-Code (IaC) methodologies.
  • Strong experience deploying and operating Kubernetes-based environments.
  • Experience supporting infrastructure for AI platforms or LLM-based applications.
  • Strong understanding of automation, scalability, reliability, and cloud-native architectures.

Preferred Qualifications

  • Experience supporting production-grade LLM applications and AI agent workloads.
  • Hands-on experience with vector databases such as Pinecone, Weaviate, or pgvector.
  • Experience building or supporting AI tooling and internal AI developer platforms.
  • Knowledge of observability, monitoring, capacity planning, and reliability engineering for AI/ML systems.
  • Experience working within financial services or other highly regulated industries.
  • Strong communication and cross-functional collaboration skills.


Benefits
Visit us at http://alignity.io/careers. Alignity Solutions is an Equal Opportunity Employer, M/F/V/D.

CEO Message: Click Here
Clients Testimonial: Click Here

Similar Jobs

21 Days Ago
Remote or Hybrid
2 Locations
150K-190K Annually
Senior level
150K-190K Annually
Senior level
Marketing Tech • Analytics
Designs, automates, and supports enterprise DevOps platforms across on-premises and hybrid cloud environments. Responsibilities include CI/CD, infrastructure as code, Linux administration, Kubernetes and container platforms, Azure and GCP operations, AI/ML infrastructure support, monitoring, reliability engineering, production support, security, disaster recovery, and cloud modernization. The role partners with infrastructure, development, security, architecture, and operations teams while participating in incident management and on-call rotations.
Top Skills: AksAnsibleAzure DevopsAzure MonitorBashDockerEksGenerative AiGkeGoogle Cloud Platform (Gcp)GrafanaJenkinsKubernetesLarge Language Models (Llms)LinuxAzureOpenshiftPowershellPrometheusPythonVector Databases
23 Seconds Ago
Remote or Hybrid
United States
85K-95K Annually
Mid level
85K-95K Annually
Mid level
Artificial Intelligence • Healthtech • Insurance • Machine Learning • Payments
Perform inpatient DRG validation audits and detailed clinical reviews of medical records and claims. Evaluate diagnoses, procedures, documentation, sequencing, and discharge status against CMS guidelines, payer policies, and coding standards. Document defensible findings, identify unsupported diagnoses and payment errors, support quality assurance, and collaborate with payment integrity, product, and engineering teams to improve audit processes and AI-driven review models.
Top Skills: Ap-DrgApr-DrgAudit PlatformsClaims Data SystemsCms GuidelinesEhrsHipaaIcd-10-Cm/PcsMs-Drg
26 Seconds Ago
Hybrid
New York, NY, USA
160K-190K Annually
Mid level
160K-190K Annually
Mid level
Artificial Intelligence • Software
Build and deploy AI agents for commercial insurers, from custom demos and customer-site bootcamps through production adoption and expansion. Lead technical discussions with underwriters and actuaries, train customer teams, validate agent outputs, create reusable solutions, and share field insights with Product. The role combines production Python engineering, customer-facing solution design, implementation ownership, and technical sales support.
Top Skills: Ai AgentsCloud ArchitecturesPython

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account