Matrix Global Services Logo

Matrix Global Services

Senior AI/ML Platform Engineer

Posted 7 Days Ago
Remote
Hiring Remotely in United States
Senior level
Remote
Hiring Remotely in United States
Senior level
Lead the implementation of generative AI and machine learning solutions, focusing on architecture, governance, and collaboration with teams to ensure compliance with AI standards.
The summary above was generated by AI

Job Title: Senior AI/ML Platform Engineer

Position Summary

We are seeking a Senior AI/ML Platform Engineer to lead the strategic implementation, scaling, and governance of generative AI and machine learning capabilities across enterprise cloud environments. This senior individual contributor role blends deep technical expertise with strategic execution, focusing on designing, architecting, and delivering production‑grade AI systems using leading cloud AI platforms and enterprise LLM frameworks.

The ideal candidate brings hands‑on experience with large language models, advanced ML engineering, AI security, and MLOps/LLMOps best practices. This role partners closely with engineering, data science, and business teams to deliver high‑impact AI solutions while ensuring adherence to responsible AI and regulatory standards.

Key Responsibilities

  • Architect and implement end‑to‑end generative AI solutions using cloud AI ecosystems such as Azure AI and Google Vertex AI.
  • Lead development of production-grade LLM applications, including RAG pipelines, prompt engineering, fine‑tuning, LLM grounding, and multi‑agent workflows to achieve measurable business outcomes.
  • Implement and maintain AI security controls, such as prompt‑injection defenses, adversarial attack mitigation, data‑poisoning detection, and prompt‑shielding mechanisms.
  • Develop solutions for content filtering, output monitoring, and automated AI safety guardrails for generative systems.
  • Design and maintain scalable MLOps and AIOps pipelines, ensuring automated retraining, model versioning, observability, and explainability with high service availability (99.9%).
  • Translate strategic objectives into actionable AI/ML Proof‑of‑Concepts and production systems, demonstrating ROI through iterative development and rapid prototyping.
  • Shape technical strategy for expanding AI/ML capabilities across hybrid cloud environments, assessing emerging technologies such as small language models, agentic AI, and edge inference.
  • Provide mentorship and technical leadership to platform engineers and data scientists on advanced ML, LLMOps, and responsible AI methodologies.
  • Conduct technical evaluations and due diligence of AI vendors and tools, including emerging technologies such as Cohere, Anthropic, and open‑source LLM ecosystems.

Required Skills & Qualifications

  • Bachelor’s degree in Computer Science, Machine Learning, Mathematics, or a related technical discipline.
  • 5+ years of hands‑on AI/ML engineering experience, including 3+ years working directly with generative AI and LLM‑based applications.
  • 5+ years of senior‑level or executive‑facing experience with the ability to influence senior stakeholders and lead strategic technical initiatives.
  • Expert proficiency in Python, including ML frameworks such as PyTorch and TensorFlow, and LLM orchestration frameworks including LangChain and LlamaIndex.
  • Extensive experience with enterprise cloud AI platforms, including Azure OpenAI Service, Azure ML Studio, Databricks MLflow, and Google Vertex AI.
  • Strong knowledge of MLOps/LLMOps practices, including CI/CD for ML (Azure DevOps, GitHub Actions), infrastructure‑as‑code (Terraform), and containerization (Docker, Kubernetes).
  • Experience with real‑time ML inference, streaming data architectures (Kafka, Pub/Sub), and edge deployment for low‑latency applications.
  • Hands‑on experience with multi‑modal models, computer vision, and advanced NLP techniques beyond standard LLM text generation.


Matrix is a global, dynamic, fast-growing technical consultancy leading technology services company with 13000 employees worldwide. Since its foundation in 2001, Matrix has made more travelers and acquisitions and has executed some of the largest, most significant. The company specializes in implementing and developing leading technologies, software solutions, and products. It provides its customers with infrastructure and consulting services, IT outsourcing, offshore, training and assimilation, and Ves as representatives for the world's leading software vendors.  With vast experience in private and public sectors, ranging from Finance, Telecom, Health, Hi-Tech, Education, Defense, and Secu city, Matrix's customer base includes guest organizations in Israel and a steadily growing client base worldwide. 

We are comprised of talented, creative, and dedicated individuals passionate about delivering innovative solutions to the market. We source and foster the best talent and recognize that all employee's contributions are integral to our company's future. 

Matrix- success is based on a challenging work environment, competitive compensation and benefits, and rewarding career opportunities. We encourage a diverse work environment of sharing, learning, and ceding together. Come and join the winning team! You'll be challenged and have fun in a highly respected organization. To Learn More, Visit Matrix -ifs. Com, 

Top Skills

Azure Ai
Azure Ml Studio
Azure Openai Service
Databricks Mlflow
Docker
Google Vertex Ai
Kafka
Kubernetes
Langchain
Llamaindex
Pub/Sub
Python
PyTorch
TensorFlow
Terraform

Matrix Global Services New York, New York, USA Office

590 Madison Ave, 21st Floor, New York, New York, United States, 10022

Similar Jobs

11 Days Ago
Remote
USA
180K-200K Annually
Senior level
180K-200K Annually
Senior level
Artificial Intelligence • Machine Learning • Software • Analytics
The Senior Software Engineer will design and build infrastructure for ML model training and deployment, focusing on AWS technologies, reliability, and collaboration with ML teams.
Top Skills: Amazon SagemakerAWSCi/CdNoSQLPythonPyTorchRedshiftScikit-LearnSnowflakeSQLTensorFlow
7 Days Ago
Remote or Hybrid
Mountain View, CA, USA
170K-240K Annually
Senior level
170K-240K Annually
Senior level
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
As a Senior AI/ML Engineer, you'll enhance developer productivity by leading CI solutions, mentoring engineers, and implementing scalable systems.
Top Skills: DockerGCPGoKubernetesPython
An Hour Ago
Remote or Hybrid
Boston, MA, USA
120K-130K Annually
Junior
120K-130K Annually
Junior
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Big Data Analytics • Automation
Support post-sales product initiatives by gathering requirements, maintaining roadmaps, coordinating cross-functional teams, analyzing KPIs, preparing reports, and creating enablement documentation to improve operational efficiency.
Top Skills: Dynatrace,Davis Hypermodal Ai,Aws,Microsoft,Google Cloud,Saas,Automation Platforms,Analytics Tools,Data Analysis Tools

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account