Design, build, and deploy production machine learning and LLM systems, including RAG pipelines, agentic workflows, fine-tuning, and embeddings. Own technical delivery from architecture through monitoring and iteration, collaborate with client engineering and product teams, mentor junior ML engineers, and help establish internal technical standards and best practices.
About TensorOps
TensorOps is a boutique AI consultancy that bridges strategy and execution, we design and ship production-grade AI systems for enterprise clients, from Fortune 500 companies to fast-growing unicorns. Our work spans agentic AI, LLM fine-tuning, RAG systems, and ML-driven products, deployed on AWS, GCP, and Azure.
We've shipped AI systems impacting 200M+ end users daily, partnered with 11 unicorns and NASDAQ-listed companies (including Notion, ServiceNow, JFrog, Seeking Alpha, Armis, and GoCardless), and get 95% of validated ideas into production within two months. We're Google Cloud, AWS, and Cloudflare partners, and we're 100% remote by design.
About the roleWe're hiring a Mid/Senior ML Engineer to contribute to technical direction across client engagements and mentor a growing team of junior ML engineers. You'll work directly with clients, taking AI systems from prototype to production-grade deployment.
In this role, you will:
- Design, build, and deploy production ML and LLM-based systems (RAG, agentic workflows, fine-tuning, embeddings) for enterprise clients
- Own technical delivery end-to-end: from architecture and prototyping to deployment, monitoring, and iteration
- Work directly with client engineering and product teams to translate business needs into scoped, shippable technical solutions
- Mentor and support other ML engineers on the team — code reviews, technical guidance, and knowledge sharing
- Help shape internal best practices, tooling, and technical standards as the team grows
- Represent TensorOps technically in client conversations, workshops, and (optionally) at industry conferences
You’ll be part of a supportive, fast-growing team that values autonomy, open communication, and continuous learning.
Requirements- 2+ years of professional experience in Machine Learning, AI Engineering, or a related role (Mid-level) / 5+ years for Senior
- Strong hands-on skills in Python, writing clean, efficient, well-documented, production-quality code
- Proven experience designing, training, optimizing, and deploying ML models independently (e.g., PyTorch, TensorFlow, Scikit-learn)
- Experience building GenAI & LLM systems: RAG pipelines, chatbot architectures, and applications using tools like LangChain
- Familiarity with MLOps & production ML practices: model versioning, monitoring, CI/CD for ML workflows
- Experience deploying and scaling ML systems on AWS, GCP, or Azure
- Strong performance optimization and debugging skills (diagnosing complex issues and improving system reliability and efficiency)
- Experience working with stakeholders or clients is a plus
- 100% Remote Work: no mandatory office days, work from wherever
- Funded certifications: fully paid AWS and GCP professional certifications
- Dynamic, High-Impact Projects: Work on cutting-edge ML and GenAI solutions across diverse industries
- International Clients: Collaborate with global organizations and solve real-world challenges at scale
- Urban Sports Club Membership: Supporting your physical and mental wellbeing
- Monthly Bolt Credits: For rides
- Company Events & Offsites: Regular team gatherings to connect, collaborate, and celebrate
TensorOps New York, New York, USA Office
New York, New York, United States
Similar Jobs
AdTech • Artificial Intelligence • Big Data • Machine Learning • Marketing Tech • Mobile • Software
Design, build, and operate high-throughput, low-latency ad-serving infrastructure processing millions of requests per second. Optimize GPU-powered TensorRT inference, feature stores, model serving, benchmarking, experimentation tooling, and system reliability. Partner with machine learning engineers to productionize models and own systems through design, deployment, observability, capacity planning, incident response, and optimization.
Top Skills:
Big DataFeature StoresGoGpusMachine LearningTensorrt
Artificial Intelligence • Enterprise Web • Information Technology • Productivity • Sales • Software • Database
Own and expand Apollo’s partnerships with foundation model companies, agent harnesses, and AI-native platforms. Identify new integration surfaces, drive partner certification and compliance, develop monetization strategies, and coordinate multi-party partnerships. Collaborate with R&D to design and launch MCP servers, plugins, skills, and agent tools while tracking fast-changing AI ecosystem developments and shaping Apollo’s partnership strategy.
Top Skills:
Agent ToolsApi DocumentationAPIsFoundation ModelsIntegration ArchitectureMcpPlugins
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Analyze product, customer, risk, and support data to guide decisions across Block’s platforms. Own metrics, forecasting, staffing models, experiments, visualizations, and measurement frameworks. Evaluate risk models and policies for performance, bias, and drift; use AI tools and agent workflows to improve analytical execution. Partner with product, engineering, and risk stakeholders, lead technical standards, build reusable tooling, mentor data scientists, and contribute to hiring.
Top Skills:
Agent WorkflowsAi ToolsData VisualizationSQL
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
