Remote full-time MLOps Engineer role to design, evaluate, and improve ML infrastructure and large-scale training systems. Develop and review challenging MLOps tasks, optimize GPU kernels (Pallas/Triton), create evaluation rubrics, and collaborate with researchers to improve model reasoning and training pipelines. Requires production JAX/PyTorch experience and strong distributed training knowledge.
This role is for one of our clients
Compensation: $70-$110 per hour
Join a cutting-edge AI research initiative at the forefront of Generative AI and contribute to the development of next-generation Large Language Models. We are seeking experienced MLOps Engineers with deep expertise in modern machine learning frameworks, large-scale training infrastructure, and kernel-level optimization.
In this role, you'll leverage your knowledge of JAX, PyTorch, and custom GPU kernel programming (Pallas/Triton) to create, evaluate, and refine high-quality technical tasks that help train frontier AI systems. You'll collaborate with AI researchers and engineering teams to improve model reasoning across MLOps, distributed training, and ML infrastructure topics.
This is a full-time, 40-hour-per-week remote engagement requiring full weekday availability.
RequirementsKey Responsibilities
- Partner with research and engineering teams to strengthen AI model capabilities in MLOps, ML infrastructure, and large-scale training systems.
- Design challenging, real-world MLOps and machine learning systems tasks that reflect production engineering scenarios.
- Develop accurate, well-documented solutions to complex ML infrastructure and training pipeline problems.
- Review and evaluate technical tasks and AI-generated solutions, providing clear and actionable written feedback.
- Create detailed evaluation rubrics and scoring frameworks for topics including:
- Distributed training architectures
- ML pipeline design
- Infrastructure optimization
- Kernel-level programming
- Performance tuning
- Collaborate with fellow subject matter experts to maintain consistency, quality, and technical accuracy across training datasets.
- Contribute domain expertise to improve the reasoning capabilities of advanced AI systems.
- Minimum 2 years of professional experience in MLOps, Machine Learning Infrastructure, or ML Systems Engineering within a recognized technology organization.
- Hands-on production experience with JAX and/or PyTorch in large-scale machine learning environments.
- Practical experience developing or optimizing custom GPU kernels using Pallas (JAX) or Triton.
- Strong understanding of distributed training systems, model optimization, and scalable ML infrastructure.
- Demonstrated career growth and increasing technical responsibility.
- Availability to work 40 hours per week during standard weekday business hours.
- Excellent written communication skills with the ability to clearly explain technical concepts and architectural decisions.
- Experience designing and optimizing large-scale ML training pipelines.
- Knowledge of distributed computing and GPU performance optimization.
- Familiarity with evaluation methodologies for AI models and ML systems.
- Experience collaborating with research teams on advanced machine learning projects.
- Passion for advancing AI infrastructure and frontier model development.
- Help build and improve next-generation Large Language Models.
- Work alongside leading AI researchers and experienced machine learning engineers.
- Apply your expertise to high-impact projects involving large-scale ML systems and infrastructure.
- Contribute directly to the development of cutting-edge AI technologies.
- Enjoy a fully remote engagement with meaningful technical challenges.
We welcome applications from qualified professionals regardless of legally protected characteristics and are committed to providing reasonable accommodations throughout the application and engagement process upon request.
Contract & Payment Terms- Engagement is offered on an independent contractor basis.
- This is a fully remote opportunity that can be completed according to your own schedule.
- Project duration may be extended, shortened, or concluded based on project requirements and individual performance.
- The engagement does not require access to confidential or proprietary information belonging to any current employer, client, or institution.
- Payments are processed weekly through Stripe or Wise based on approved work completed.
- Please note: Applicants requiring H-1B sponsorship or participating in the STEM OPT program are not eligible for this opportunity.
Similar Jobs
Fintech • Financial Services
Serve as first point of contact for clients managing self-directed retirement accounts via chat, phone, and email. Educate customers on products, resolve inquiries end-to-end, build trust, provide proactive recommendations, and collaborate with internal teams to ensure satisfaction and retention.
Top Skills:
MS Office
Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
Manages global treasury operations, including cash and liquidity management, forecasting, FX exposure and hedging, investments, banking relationships, debt facilities, reconciliations, compliance, and treasury systems. The role leads process optimization, automation, controls, insurance renewals, and the implementation of Trovata Treasury Management System while partnering with finance, accounting, tax, IT, banks, and senior leadership.
Top Skills:
Banking PortalsGlobal AchHost-To-Host ConnectivityTreasury Management SystemsTrovata
eCommerce • Information Technology • Retail • Industrial
Lead development, deployment, and operationalization of statistical and machine learning models for Grainger's digital products. Design and automate experiments, analyze large datasets, perform feature engineering, and present actionable insights to stakeholders. Support digital product areas (search, recommendations, checkout), mentor junior team members, and apply techniques including regression, classification, boosting, NLP, and time series forecasting.
Top Skills:
AWSDashOraclePowerPointPythonRShinySnowflakeSQLStreamlitTeradata
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
