The MLOps Engineer will design scalable ML infrastructure, manage containerized environments, develop training pipelines, and implement CI/CD pipelines, ensuring model reliability and performance.
Location: Fully Remote
Preferred Locations: Midwest-based; Indianapolis, IN or IL, Chicagoland Area preferred
Who We Are
We are K1X. Our platform powers a modern, all-digital K-1 experience by replacing legacy workflows with scalable software and AI-driven automation.
As we expand our machine learning capabilities, we are investing in a robust ML platform that enables production-grade model development, deployment, and monitoring across our products.
About your Role
We’re seeking an experienced Machine Learning Operations (MLOps) Engineer to join our team and build the infrastructure that powers AI and machine learning at K1X.
This is a hands-on role focused on designing scalable systems, pipelines, and tooling that enable our Machine Learning Engineers to efficiently train, deploy, and operate models in production.
You’ll work at the intersection of software engineering, DevOps, and machine learning—owning the reliability, scalability, and performance of our ML platform.
Your Responsibilities
- Design and build scalable ML infrastructure to support model training, evaluation, and deployment.
- Develop and maintain containerized environments using Docker and Kubernetes.
- Build and manage distributed training pipelines and orchestration workflows.
- Implement and maintain ML lifecycle tooling such as MLflow for experiment tracking and reproducibility.
- Own production inference systems, including NVIDIA Triton Inference Server.
- Design and operate low-latency, high-availability model serving architectures.
- Implement CI/CD pipelines for ML deployment, versioning, and rollback strategies.
- Build and maintain data pipelines integrated with Snowflake and related data systems.
- Implement monitoring, logging, and alerting for model performance, drift detection, and system health.
- Partner with ML Engineers to improve developer experience and accelerate delivery.
Requirements
Who You Are:
- Bachelor’s or Master’s degree in Computer Science, Engineering, or equivalent experience.
- 5+ years of experience in software engineering, DevOps, or MLOps roles.
- Strong proficiency in Python and experience building production-grade systems.
- Hands-on experience with Docker, Kubernetes, and distributed systems.
- Experience building and maintaining CI/CD pipelines.
- Familiarity with ML lifecycle tools such as MLflow or similar.
- Experience working with cloud-based data platforms such as Snowflake.
- Strong understanding of system design, APIs, and microservices architectures.
- Proven debugging and troubleshooting ability across distributed systems.
It's Truly a Match If You Have:
- Experience managing inference infrastructure such as NVIDIA Triton Inference Server.
- Experience building large-scale training infrastructure including GPU workloads and distributed training.
- Familiarity with feature stores, data versioning, and experiment tracking systems.
- Experience supporting NLP or document processing pipelines.
- Exposure to observability tools such as Prometheus, Grafana, or similar.
- Experience working in SaaS environments with high availability, productivity, and performance requirements.
- A strong bias toward automation, scalability, and continuous improvement.
- A collaborative mindset and ability to work cross-functionally with engineering and data teams.
Benefits
- Unlimited Vacation Policy + Sick Time
- Fully Remote Opportunity
- Benefits/401K
- Growing Startup Culture
- Unlimited Vacation Policy + Sick Time + Holidays
- Paid Parental Leave
- Fully Remote Opportunity
- Healthcare Benefits and 401K
- Growing Startup Culture
Top Skills
Docker
Kubernetes
Mlflow
Nvidia Triton Inference Server
Python
Snowflake
Similar Jobs
Artificial Intelligence • Machine Learning • Natural Language Processing • Software • Conversational AI
As an ML Ops Infrastructure Engineer, you will design CI/CD pipelines for ML, maintain deployment systems, and implement monitoring while collaborating with research teams to ensure model quality and performance.
Top Skills:
Ci/CdDatadogDockerGrafanaKubernetesNvidia Triton Inference ServerOnnx RuntimePrometheusPulumiPythonTensorrtTerraform
Digital Media • News + Entertainment
The role involves designing and automating MLOps systems, maintaining ML training pipelines, deploying models, and optimizing infrastructure for machine learning experimentation.
Top Skills:
AirflowArgoAWSAzureCloudFormationDockerGCPGithub ActionsGitlab CiJenkinsKubeflowMlflowPrefectPulumiPythonPyTorchTensorFlowTerraformWeights & Biases
Information Technology • Software
The Principal ML Ops Engineer will design, implement, and scale ML infrastructure, focusing on optimizing AI systems, collaborating with teams, and establishing best practices for ML Ops.
Top Skills:
AWSAzureCudaDockerGCPGoHelmKubernetesLlama-FactoryMegatron-LmMl FrameworksPythonPyTorchTransformersTypescriptVllm
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
