Design, build, deploy, monitor, and optimize production ML and LLM systems, including RAG pipelines, agentic workflows, fine-tuning, and embeddings. Own technical delivery from architecture through iteration, collaborate with client engineering and product teams, mentor junior ML engineers, and help establish internal technical standards and tooling.
About TensorOps
TensorOps is a boutique AI consultancy that bridges strategy and execution, we design and ship production-grade AI systems for enterprise clients, from Fortune 500 companies to fast-growing unicorns. Our work spans agentic AI, LLM fine-tuning, RAG systems, and ML-driven products, deployed on AWS, GCP, and Azure.
We've shipped AI systems impacting 200M+ end users daily, partnered with 11 unicorns and NASDAQ-listed companies (including Notion, ServiceNow, JFrog, Seeking Alpha, Armis, and GoCardless), and get 95% of validated ideas into production within two months. We're Google Cloud, AWS, and Cloudflare partners, and we're 100% remote by design.
About the roleWe're hiring a Mid-Level ML Engineer to contribute to technical direction across client engagements and mentor a growing team of junior ML engineers. You'll work directly with clients, taking AI systems from prototype to production-grade deployment.
In this role, you will:
- Design, build, and deploy production ML and LLM-based systems (RAG, agentic workflows, fine-tuning, embeddings) for enterprise clients
- Own technical delivery end-to-end: from architecture and prototyping to deployment, monitoring, and iteration
- Work directly with client engineering and product teams to translate business needs into scoped, shippable technical solutions
- Mentor and support other ML engineers on the team — code reviews, technical guidance, and knowledge sharing
- Help shape internal best practices, tooling, and technical standards as the team grows
- Represent TensorOps technically in client conversations, workshops, and (optionally) at industry conferences
You’ll be part of a supportive, fast-growing team that values autonomy, open communication, and continuous learning.
Requirements- 2+ years of professional experience in Machine Learning, AI Engineering, or a related role
- Strong hands-on skills in Python, writing clean, efficient, well-documented, production-quality code
- Proven experience designing, training, optimizing, and deploying ML models independently (e.g., PyTorch, TensorFlow, Scikit-learn)
- Experience building GenAI & LLM systems: RAG pipelines, chatbot architectures, and applications using tools like LangChain
- Familiarity with MLOps & production ML practices: model versioning, monitoring, CI/CD for ML workflows
- Experience deploying and scaling ML systems on AWS, GCP, or Azure
- Strong performance optimization and debugging skills (diagnosing complex issues and improving system reliability and efficiency)
- Experience working with stakeholders or clients is a plus
- 100% Remote Work: no mandatory office days, work from wherever
- Funded certifications: fully paid AWS and GCP professional certifications
- Dynamic, High-Impact Projects: Work on cutting-edge ML and GenAI solutions across diverse industries
- International Clients: Collaborate with global organizations and solve real-world challenges at scale
- Urban Sports Club Membership: Supporting your physical and mental wellbeing
- Monthly Bolt Credits: For rides
- Company Events & Offsites: Regular team gatherings to connect, collaborate, and celebrate
TensorOps New York, New York, USA Office
New York, New York, United States
Similar Jobs
Financial Services
Coordinates group air travel programs from intake and setup through post-event follow-up. Serves as a liaison among clients, travel advisors, and internal teams; manages timelines, documentation, bookings, traveler activity, arrivals, departures, reports, quality control, and stakeholder updates. Requires three or more years of travel-industry experience, GDS or self-booking tool proficiency, Microsoft Office skills, strong communication, and multitasking abilities.
Top Skills:
Global Distribution Systems (Gds)ExcelMicrosoft OutlookMicrosoft WordSelf-Booking Tools
Cloud • Fintech • Food • Information Technology • Software • Hospitality
Support Toast’s enterprise data governance program by managing governance dashboards, business glossaries, metadata standards, compliance monitoring, documentation, stewardship training, and data quality tracking. Collaborate with Engineering, Analytics, Legal, and data catalog teams to translate business definitions into technical specifications, automate data discovery, facilitate governance workshops, and improve data management and AI governance practices.
Top Skills:
AlationAtlanDatahubDbtGreat ExpectationsMonte CarloSnowflakeSQL
Cloud • Fintech • Food • Information Technology • Software • Hospitality
Lead development of Toast’s consumer-facing web experiences, building scalable guest and restaurant features across the stack. Collaborate with frontend, backend, iOS, and Android engineers using React, TypeScript, Next.js, APIs, and backend services. Own projects from development through launch, monitoring, and analysis while experimenting with users and influencing consumer product strategy.
Top Skills:
AndroidGraphQLiOSJavaKotlinNext.JsReactRestTypescript
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
