Red Hat Logo

Red Hat

Architect, AI Platform

Posted 4 Days Ago
Be an Early Applicant
In-Office or Remote
Hiring Remotely in New York, NY, USA
142K-235K Annually
Senior level
In-Office or Remote
Hiring Remotely in New York, NY, USA
142K-235K Annually
Senior level
Lead architecture and delivery of an enterprise AI platform on Red Hat OpenShift/RHOAI. Design container-native MLOps pipelines, guide model selection and low-latency model serving (KServe, vLLM, TGI, Triton), implement automated benchmarking, run PoCs, consult with customers and execs, document blueprints, and mentor teams to operationalize production-grade LLM/ML workloads.
The summary above was generated by AI

We are seeking a visionary Red Hat Architect specializing in Machine Learning Operations (MLOps) and Artificial Intelligence (AI) to design, build, and scale our enterprise AI platform. In this role, you will bridge the gap between enterprise-grade infrastructure and cutting-edge artificial intelligence.

You will lead the architectural design of our container-native machine learning pipelines on Red Hat OpenShift, with a heavy focus on Large Language Models (LLMs), containerized model serving, scalable runtime environments, and automated benchmarking.

What you will do:

  • Design and advocate solutions that leverage the full Red Hat ecosystem to solve complex business problems, explicitly aligning AI/ML capabilities with customer strategic goals.

  • Work hand-in-hand with customer associates and executive stakeholders to guide the adoption of Artificial Intelligence and MLOps processes, drastically improving model time-to-market and operational efficiency.

  • Collaborate with project and customer team members to manage scope, mitigate architectural risks, and consistently meet delivery timelines and project goals.

  • Participate in consulting sales motions to discover customer pain points, scope complex engineering engagements, architect high-level proposals, and deliver compelling technical demonstrations/proof-of-concepts (PoCs).

  • Contribute heavily to project documentation and diagrams, capturing architectural blueprints, deployment guides, and best practices to ensure long-term customer success and internal knowledge reuse.

  • Commit to continuous training and professional development to stay at the absolute forefront of the rapidly evolving LLM, MLOps, and Cloud-Native ecosystem.

  • Architect and build production-grade MLOps pipelines using Red Hat OpenShift Container Platform and Red Hat OpenShift AI (RHOAI).

  • Guide customers through Model Selection (e.g., Llama, Mistral, Granite) by analyzing specific business use cases against hardware/GPU memory constraints, cost profiles, and licensing models.

  • Design containerized Model Deployment architectures using KServe, optimizing low-latency Inference Servers (e.g., vLLM, TGI, Triton) within OpenShift environments.

  • Establish automated Benchmarking and Test pipelines to measure tokens-per-second throughput, hardware efficiency, and cost-per-inference metrics.

  • Mentor and share knowledge with customers through structured workshops, paired programming sessions, and architectural reviews, empowering their internal teams to confidently manage the platform post-delivery.

  • Act as an internal champion, coaching junior consultants and engineering associates on the nuances of deploying AI workloads on Kubernetes.

What you will bring:

  • 8-10 years in a related technology position, e.g., sales, consulting, operations, development, etc

  • 5+ years of experience with Public Cloud and Linux technologies

  • 3+ years of experience with Red Hat OpenShift Container Platform or Kubernetes

  • 3+ years experience in production ready AI solutions.

  • 3+ years experience in production ready Machine Learning use cases.

Nice to have:

  • Experience in designing and delivering implementations using various public and private cloud infrastructure technologies and providers

  • Red Hat Certified Architect (RHCA) or Specialist certifications in OpenShift.

  • Demonstrated experience publishing technical whitepapers, architectural blueprints, or speaking at industry conferences (e.g., Red Hat Summit, KubeCon).

  • Experience in Financial Services

The salary range for this position is $142,370.00 - $234,770.00. Actual offer will be based on your qualifications.

Pay Transparency

Red Hat determines compensation based on several factors including but not limited to job location, experience, applicable skills and training, external market value, and internal pay equity. Annual salary is one component of Red Hat’s compensation package. This position may also be eligible for bonus, commission, and/or equity. For positions with Remote-US locations, the actual salary range for the position may differ based on location but will be commensurate with job duties and relevant work experience. 

About Red Hat

Red Hat is the world’s leading provider of enterprise open source software solutions, using a community-powered approach to deliver high-performing Linux, cloud, container, and Kubernetes technologies. Spread across 40+ countries, our associates work flexibly across work environments, from in-office, to office-flex, to fully remote, depending on the requirements of their role. Red Hatters are encouraged to bring their best ideas, no matter their title or tenure. We're a leader in open source because of our open and inclusive environment. We hire creative, passionate people ready to contribute their ideas, help solve complex problems, and make an impact.

Benefits
●    Comprehensive medical, dental, and vision coverage
●    Flexible Spending Account - healthcare and dependent care
●    Health Savings Account - high deductible medical plan
●    Retirement 401(k) with employer match
●    Paid time off and holidays
●    Paid parental leave plans for all new parents
●    Leave benefits including disability, paid family medical leave, and paid military leave
●    Additional benefits including employee stock purchase plan, family planning reimbursement, tuition reimbursement, transportation expense account, employee assistance program, and more! 

Note: These benefits are only applicable to full time, permanent associates at Red Hat located in the United States. 

Inclusion at Red Hat
Red Hat’s culture is built on the open source principles of transparency, collaboration, and inclusion, where the best ideas can come from anywhere and anyone. When this is realized, it empowers people from different backgrounds, perspectives, and experiences to come together to share ideas, challenge the status quo, and drive innovation. Our aspiration is that everyone experiences this culture with equal opportunity and access, and that all voices are not only heard but also celebrated. We hope you will join our celebration, and we welcome and encourage applicants from all the beautiful dimensions that compose our global village.

Equal Opportunity Policy (EEO)
Red Hat is proud to be an equal opportunity workplace and an affirmative action employer. We review applications for employment without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, ancestry, citizenship, age, veteran status, genetic information, physical or mental disability, medical condition, marital status, or any other basis prohibited by law.


Red Hat does not seek or accept unsolicited resumes or CVs from recruitment agencies. We are not responsible for, and will not pay, any fees, commissions, or any other payment related to unsolicited resumes or CVs except as required in a written contract between Red Hat and the recruitment agency or party requesting payment of a fee.
Red Hat supports individuals with disabilities and provides reasonable accommodations to job applicants. If you need assistance completing our online job application, email [email protected]. General inquiries, such as those regarding the status of a job application, will not receive a reply. 

Red Hat Hillsborough, New Jersey, USA Office

Hillsborough, United States

Red Hat Jersey City, New Jersey, USA Office

Jersey City, United States

Red Hat New York, New York, USA Office

140 Broadway, New York, NY, United States, 10005

Red Hat Newark, New Jersey, USA Office

Newark, United States

Similar Jobs

8 Days Ago
Remote
United States
137K-247K Annually
Expert/Leader
137K-247K Annually
Expert/Leader
Big Data • Marketing Tech • Analytics
Lead architecture and evolution of enterprise-scale data, analytics, and MLOps platforms. Design AI-ready data foundations, semantic/ontology and federated catalog solutions, APIs and permission-aware discovery. Drive adoption through reference architectures, prototyping, R&D, and mentorship while ensuring security, governance, cost efficiency, and cloud-native operational excellence.
Top Skills: APIsAWSCloud-NativeDistributed ComputingFederated Data CatalogInfrastructure As CodeMlopsModel Deployment And MonitoringSemantic Web/Ontology
10 Days Ago
Remote
USA
174K-239K Annually
Senior level
174K-239K Annually
Senior level
Hardware • Other • Appliances
Lead design and scaling of enterprise AI platforms (LLMs, agents, analytics) on Google Cloud with multi-cloud portability. Build developer self-service platforms, CI/CD and IaC, integrate AI with ERP and supply chain data, ensure secure governance and compliance, and mentor engineering and data science teams to accelerate production AI adoption.
Top Skills: APIsAWSAzureAzure MlBigQueryCi/CdCloud ComposerCloud RunErpGoGCPIamJavaLakehouseMicroservicesPythonSagemakerSnowflakeTerraformVertex AiZero Trust
10 Days Ago
In-Office or Remote
2 Locations
Expert/Leader
Expert/Leader
Consulting • Financial Services
Lead architecture and execution of an enterprise AI platform on Azure: define multi-year roadmap, model lifecycle and evaluation standards, drive multi-LLM orchestration, enforce governance and compliance, build monitoring/observability and cost-optimization, manage identity and security controls, and enable firmwide adoption and executive reporting across Tax, Audit, Advisory, and Outsourcing.
Top Skills: AdlsAi SearchAzure Ai FoundryAzure OpenaiCosmos DbAzureMicrosoft Purview

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account