The role involves designing, architecting, and implementing a multi-tenant OpenShift cluster on bare metal, migrating workloads, supporting DevOps, and ensuring operational stability.
Role Overview
We are building a high-performance, multi-tenant OpenShift cluster on bare metal in our AI-optimized data center. Our goal is to offer OpenShift as a Service to private AI-focused clients who wish to host their compute-intensive workloads in a scalable, secure, and isolated environment.
We’re looking for a hands-on Red Hat OpenShift Engineer who can design, architect, and implement this platform from scratch using industry best practices. Once the cluster is built, this role will also lead the migration of existing on-prem and Azure workloads to the new OpenShift environment.
Key Responsibilities
- Design, architect, and build a multi-tenant OpenShift cluster on bare metal
- Configure and maintain all aspects of the OpenShift platform for high availability, scalability, and security
- Define and implement networking, storage, ingress, monitoring, and logging
- Develop detailed architecture documents, blueprints, and SOPs
- Lead and execute migration of existing workloads from on-premise and Azure environments to OpenShift
- Ensure smooth onboarding for multiple AI-focused client tenants with isolated environments
- Support DevOps team with advanced Linux/OpenShift troubleshooting
- Implement and enforce RBAC, tenant isolation, resource quotas, and compliance controls
- Optimize performance for AI-heavy workloads running on GPU-enabled infrastructure
- Own operational stability, platform upgrades, and monitoring
Required Skills & Experience
- 5+ years of deep hands-on experience with Red Hat OpenShift and Kubernetes
- Proven experience designing, building, and managing bare metal OpenShift clusters
- Solid understanding of Linux internals, container runtimes, networking, and troubleshooting
- Experience with application migration from both on-premise and Azure environments into OpenShift
- Strong experience with multi-tenancy architecture, including workload isolation and security
- Familiarity with storage (CSI), networking (CNI), and service mesh implementations
- Proficiency in monitoring and observability tools (e.g., Prometheus, Grafana, ELK)
- Experience with Infrastructure as Code (Ansible, Terraform) and CI/CD automation
- Strong documentation and communication skills
Certifications (Required)
- Red Hat Certified Specialist in OpenShift Administration
- Red Hat Certified Engineer (RHCE) or equivalent Linux certification
Nice to Have
- Familiarity with AI/ML compute environments (e.g., GPU workloads, NVIDIA operators)
- Experience with hybrid cloud or edge computing models
- Exposure to enterprise-grade security, compliance, and policy enforcement
Top Skills
Ansible
Azure
Docker
Elk
Grafana
Kubernetes
Linux
Prometheus
Red Hat Openshift
Terraform
Similar Jobs
Information Technology • Consulting
The role involves designing, architecting, and managing a multi-tenant Red Hat OpenShift cluster on bare metal and migrating workloads from on-prem and Azure environments while ensuring security and performance for AI workloads.
Top Skills:
AnsibleElkGrafanaKubernetesLinuxPrometheusRed Hat OpenshiftTerraform
Cloud • Information Technology • Internet of Things • Software • Consulting • Infrastructure as a Service (IaaS) • Automation
As a Senior Site Reliability Engineer, you'll develop and manage OpenShift services, improve reliability, automate processes, and troubleshoot issues to enhance customer experiences.
Top Skills:
AnsibleAzureDockerGoJavaKubernetesOpenshiftPrometheusPythonRed Hat Enterprise Linux
Artificial Intelligence • Cloud • Machine Learning • Mobile • Software • Virtual Reality • App development
Develop features for Android applications, conduct code reviews, and evaluate technical tradeoffs while ensuring great user experiences.
Top Skills:
DaggerJavaKotlinRxjava
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
