Design, build, deploy, monitor, and optimize production ML and LLM systems, including RAG pipelines, agentic workflows, fine-tuning, and embeddings. Own technical delivery from architecture through iteration, collaborate with client engineering and product teams, mentor junior ML engineers, and help establish internal technical standards and tooling.
About TensorOps
TensorOps is a boutique AI consultancy that bridges strategy and execution, we design and ship production-grade AI systems for enterprise clients, from Fortune 500 companies to fast-growing unicorns. Our work spans agentic AI, LLM fine-tuning, RAG systems, and ML-driven products, deployed on AWS, GCP, and Azure.
We've shipped AI systems impacting 200M+ end users daily, partnered with 11 unicorns and NASDAQ-listed companies (including Notion, ServiceNow, JFrog, Seeking Alpha, Armis, and GoCardless), and get 95% of validated ideas into production within two months. We're Google Cloud, AWS, and Cloudflare partners, and we're 100% remote by design.
About the roleWe're hiring a Mid-Level ML Engineer to contribute to technical direction across client engagements and mentor a growing team of junior ML engineers. You'll work directly with clients, taking AI systems from prototype to production-grade deployment.
In this role, you will:
- Design, build, and deploy production ML and LLM-based systems (RAG, agentic workflows, fine-tuning, embeddings) for enterprise clients
- Own technical delivery end-to-end: from architecture and prototyping to deployment, monitoring, and iteration
- Work directly with client engineering and product teams to translate business needs into scoped, shippable technical solutions
- Mentor and support other ML engineers on the team — code reviews, technical guidance, and knowledge sharing
- Help shape internal best practices, tooling, and technical standards as the team grows
- Represent TensorOps technically in client conversations, workshops, and (optionally) at industry conferences
You’ll be part of a supportive, fast-growing team that values autonomy, open communication, and continuous learning.
Requirements- 2+ years of professional experience in Machine Learning, AI Engineering, or a related role
- Strong hands-on skills in Python, writing clean, efficient, well-documented, production-quality code
- Proven experience designing, training, optimizing, and deploying ML models independently (e.g., PyTorch, TensorFlow, Scikit-learn)
- Experience building GenAI & LLM systems: RAG pipelines, chatbot architectures, and applications using tools like LangChain
- Familiarity with MLOps & production ML practices: model versioning, monitoring, CI/CD for ML workflows
- Experience deploying and scaling ML systems on AWS, GCP, or Azure
- Strong performance optimization and debugging skills (diagnosing complex issues and improving system reliability and efficiency)
- Experience working with stakeholders or clients is a plus
- 100% Remote Work: no mandatory office days, work from wherever
- Funded certifications: fully paid AWS and GCP professional certifications
- Dynamic, High-Impact Projects: Work on cutting-edge ML and GenAI solutions across diverse industries
- International Clients: Collaborate with global organizations and solve real-world challenges at scale
- Urban Sports Club Membership: Supporting your physical and mental wellbeing
- Monthly Bolt Credits: For rides
- Company Events & Offsites: Regular team gatherings to connect, collaborate, and celebrate
TensorOps New York, New York, USA Office
New York, New York, United States
Similar Jobs
Big Data • Cloud • Software • Database
Leads MongoDB’s global brand strategy, visual identity, creative expression, and integrated marketing campaigns. Oversees multidisciplinary creative teams, develops brand systems and narrative-driven experiences, partners with executive and cross-functional stakeholders, and manages budgets, timelines, vendors, and performance metrics. The role drives brand differentiation, customer engagement, and business outcomes across digital, video, events, product experiences, social, paid media, and print while fostering creative excellence and innovation.
Top Skills:
AIDigital Asset ManagementDigital MediaGenerative DesignInteractive StorytellingMobileMotion DesignPrintSocial MediaVideo
Artificial Intelligence • Cloud • Security • Software • Cybersecurity
Partners with account executives to shape technical sales strategies, lead customer discovery, deliver product demonstrations, and manage proof-of-value evaluations. Translates customer goals into Datadog solutions, develops technical champions, supports consensus-building, and communicates feedback to product and engineering teams. Maintains accurate opportunity records and collaborates with Product, Support, and go-to-market teams to resolve technical blockers and drive adoption.
Top Skills:
Ai ToolsApmAWSAzureCloud SecurityDatadogDistributed TracingGCPKubernetesObservability
Healthtech • Information Technology • Mobile • Productivity • Software • Analytics • Telehealth
Analyze clinician platform data to identify behavioral patterns, develop product and client-facing analytics, and communicate actionable insights. The role collaborates with product managers, analysts, engineers, and other data scientists on projects spanning data ingestion, analysis, and recommendations. Responsibilities also include contributing to data team strategy and applying statistical methods, SQL, Python data libraries, visualization, and distributed data processing techniques.
Top Skills:
SparkNumpyPandasPythonSQL
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
