Top Artificial Intelligence DevOps & Platform Engineering Jobs in New York City, NY

Lead design and implementation of LLM observability features: prototype and scale product capabilities for tracing, evaluating, and debugging generative AI systems. Work cross-functionally to influence architecture, mentor engineers, prioritize customer pain points, and drive product and engineering decisions for reliable, high-performance AI observability.

Partner with Field and Product teams to design and implement LLM observability architectures, build proofs-of-concept, produce technical collateral, and advise customers to drive adoption and product feedback.

Build and maintain production infrastructure platforms (Rubix, Apollo, environment PaaS, observability) across fleets and clusters. Own full product lifecycle, collaborate with cross-functional teams, deploy secure solutions for civil and defense customers, and participate in field exercises to validate deployments.

The role involves designing and managing multi-cloud infrastructure, implementing CI/CD pipelines, ensuring platform reliability, scalability, and security, while optimizing performance for a SaaS platform used by enterprise customers.

The role involves managing and engineering platform standards and certified images across Linux and Windows environments, deploying Terraform modules, and implementing security compliance measures. Responsibilities include patch management, vulnerabilities resolution, monitoring, and cross-team collaboration to ensure successful implementation of OS standards.

Lead the Platform team in defining the roadmap, focusing on cloud infrastructure, automation, and improving developer experience while mentoring and fostering technical excellence.

As a Senior SRE, you'll ensure reliable and scalable systems, develop observability solutions and infrastructure as code, and lead incident response efforts.

Develop automated infrastructures, optimize application performance, implement monitoring tools, and resolve issues in a primarily Linux environment.

Lead and hands-on manage the Infrastructure team owning Upside's cloud platform: drive AWS architecture (cell-based), AI-assisted deployment tooling, security, CI/CD, observability, operational excellence, and cross-functional coordination to enable reliable, scalable, and secure platform services.

Lead teams to deliver AWS-based solution architecture, manage cloud migration initiatives, and innovate processes while engaging senior clients. Foster team growth and operational excellence.

The Platform Operations Engineer drives technical projects to enhance operational scalability, collaborating across teams to optimize workflows and implement new technologies.