Parallel Systems Logo

Parallel Systems

Senior ML Ops Engineer (Machine Learning Infrastructure)

Posted 18 Days Ago
In-Office or Remote
Hiring Remotely in Los Angeles, CA
150K-250K Annually
Senior level
In-Office or Remote
Hiring Remotely in Los Angeles, CA
150K-250K Annually
Senior level
Design, build, and operate scalable MLOps infrastructure for data ingestion, distributed training, deployment, CI/CD, experiment tracking, and monitoring across cloud R&D and production. Collaborate with ML, autonomy, robotics, and software teams to deliver architecture, PoCs, and production-ready ML pipelines that support real-time, safety-critical systems.
The summary above was generated by AI

Parallel Systems is pioneering autonomous battery-electric rail vehicles designed to transform freight transportation by shifting portions of the $900 billion U.S. trucking industry onto rail. Our innovative technology offers cleaner, safer, and more efficient logistics solutions. Join our dynamic team and help shape a smarter, greener future for global freight.

Senior ML Ops Engineer (Machine Learning Infrastructure)

Parallel Systems is seeking an experienced MLOps/ML Infrastructure Engineer to lead the design and development of the scalable systems that power our autonomy and perception pipelines. As we build the first fully autonomous, battery-electric rail vehicles, you will play a critical role in enabling the ML teams to develop, train, and deploy models efficiently and reliably in both R&D and real-world environments.

This is an opportunity to take full ownership of the ML infrastructure stack, from distributed training environments and experiment tracking to deployment and monitoring at scale. You’ll collaborate closely with world-class engineers in autonomy, robotics, and software, helping shape the core systems that make real-time, safety-critical ML possible. If you're driven by building robust platforms that unlock innovation in AI and robotics, we’d love to work with you. 

This can be a hybrid role (minimum of 1 week per month onsite in Los Angeles) for a senior engineer with experience in 0 to 1 builds of perception systems. 

Responsibilities:

  • Design and implement robust MLOps solutions, including automated pipelines for data management, model training, deployment and monitoring. 
  • Architect, deploy, and manage scalable ML infrastructure for distributed training and inference. 
  • Collaborate with ML engineers to gather requirements and develop strategies for data management, model development and deployment. 
  • Build and operate cloud-based systems (e.g., AWS, GCP) optimized for ML workloads in R&D, and production environments. 
  • Build scalable ML infrastructure to support continuous integration/deployment, experiment management, and governance of models and datasets. 
  • Support the automation of model evaluation, selection, and deployment workflows. 

What Success Looks Like: 

  • After 30 Days: You have developed a deep understanding of the product goals, existing infrastructure, and stakeholder requirements. You've conducted technical discovery and proposed a preliminary MLOps architecture—evaluating various ML tools, cloud services, and workflow strategies—clearly outlining pros and cons for each option. 
  • After 60 Days: You’ve delivered a detailed design document that outlines the end-to-end ML pipeline, including data ingestion, model training, deployment, and monitoring. Based on feedback from ML engineers and stakeholders, you’ve iterated on the design and built PoC for the core ML workflow aligned with the approved architecture. 
  • After 90 Days: You have delivered the core features of the MLOps pipeline and successfully integrated key tools (e.g., MLflow, SageMaker, or Kubeflow). You’ve also initiated the implementation of the remaining features, ensuring the infrastructure supports scalable, repeatable workflows for model experimentation and deployment in both R&D and production environments. 

Basic Requirements: 

  • Bachelor’s or higher degree in Computer Science, Machine Learning, or a relevant engineering discipline. 
  • 5+ years of experience building large-scale, reliable systems; 2+ years focused on ML infrastructure or MLOps. 
  • Proven experience architecting and deploying production-grade ML pipelines and platforms. 
  • Strong knowledge of ML lifecycle: data ingestion, model training, evaluation, packaging, and deployment. 
  • Hands-on experience with MLOps tools (e.g., MLflow, Kubeflow, SageMaker, Airflow, Metaflow, or similar). 
  • Deep understanding of CI/CD practices applied to ML workflows. 
  • Proficiency in Python, Git, and system design with solid software engineering fundamentals. 
  • Experience with cloud platforms (AWS, GCP, or Azure) and designing ML architectures in those environments. 

Preferred Qualifications: 

  • Experience with deep learning architectures (CNNs, RNNs, Transformers) or computer vision. 
  • Hands-on experience with distributed training tools (e.g., PyTorch DDP, Horovod, Ray). 
  • Background in real-time ML systems and batch inference, including CPU/GPU-aware orchestration. 
  • Previous work in autonomous vehicles, robotics, or other real-time ML-driven systems. 

We are committed to providing fair and transparent compensation in accordance with applicable laws. Salary ranges are listed below and reflect the expected range for new hires in this role, based on factors such as skills, experience, qualifications, and location. Final compensation may vary and will be determined during the interview process. The target hiring range for this position is listed below.

Target Salary Range:
$150,000$250,000 USD

Parallel Systems is an equal opportunity employer committed to diversity in the workplace. All qualified applicants will receive consideration for employment without regard to any discriminatory factor protected by applicable federal, state or local laws. We work to build an inclusive environment in which all people can come to do their best work.

Parallel Systems is committed to the full inclusion of all qualified individuals. As part of this commitment, Parallel Systems will ensure that persons with disabilities are provided reasonable accommodations. If reasonable accommodation is needed to participate in the job application or interview process, to perform essential job functions, and/or to receive other benefits and privileges of employment, please contact your recruiter.

Similar Jobs

58 Minutes Ago
Remote or Hybrid
United States
106K-135K Annually
Senior level
106K-135K Annually
Senior level
HR Tech • Information Technology • Professional Services • Sales • Software
Serve as the Benefits subject matter expert for the Customer Experience team, resolving complex escalations, coaching specialists, conducting QA and UAT, collaborating with Product and Engineering, and driving process and product improvements to enhance customer outcomes and first-contact resolution.
Top Skills: HrisPayroll SystemsSaas PlatformsUat
An Hour Ago
Remote or Hybrid
United States
175K-220K Annually
Expert/Leader
175K-220K Annually
Expert/Leader
Consumer Web • eCommerce • Internet of Things
Own and evolve the cloud-native platform for a multi-tenant DNS-native identity service: design infrastructure architecture, ensure production readiness (SLOs, DR, runbooks), operate DNS and PKI/signing systems, build CI/CD and supply-chain controls, instrument observability, automate audit evidence, manage cost and capacity, lead incident response and on-call, and mentor the engineering team to scale operational practices for enterprise launch.
Top Skills: ArgocdAWSCosignDnsDnssecEfkElkGCPGithub ActionsGitlab CiGoGrafanaHsmJavaScriptKmsKubernetesOpentelemetryPkiPrometheusPythonSigstoreSlsaTerraformTypescript
An Hour Ago
Remote or Hybrid
United States
Mid level
Mid level
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Manage and engage Chevrolet dealerships across the Greensboro district through frequent field visits. Drive dealer performance via mentoring, training, inventory and launch support, sales and CSI analysis, marketing coordination, and customer issue resolution to increase vehicle and parts sales.

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account