AgileEngine Logo

AgileEngine

MLOps Engineer ID72409

Reposted 2 Days Ago
Be an Early Applicant
In-Office
New York, NY, USA
Mid level
In-Office
New York, NY, USA
Mid level
Deploy, scale, and monitor computer vision models processing real-time image streams from thousands of edge cameras. Own production model serving, Azure infrastructure, GPU optimization, ingestion and inference pipelines, CI/CD, monitoring, drift detection, and model lifecycle management. Optimize throughput and costs using quantization, pruning, TensorRT, ONNX conversion, dynamic batching, and autoscaling on AKS. Collaborate with data scientists and AI researchers to transition experimental models into reliable production systems.
The summary above was generated by AI
AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.

WHY JOIN US
If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!

ABOUT THE ROLE
We are looking for an MLOps Engineer to deploy, scale, and monitor computer vision models in production on Azure, processing real-time image streams from thousands of edge cameras.

MUST HAVES
- You must be authorized to work for ANY employer in the US (e.g., Green card holders, TN visa holders, GC EAD, H4 EAD, U4U with EAD), as we are unable to sponsor or take over employment visa sponsorship at this time;
- 3+ years of professional experience in MLOps, DevOps, Data Engineering, Machine Learning, or Software Engineering.
- Degree in Computer Science, Software Engineering, or a related technical discipline (or equivalent practical experience).
- Must be based in Dallas, TX, or open to relocating to Dallas. Office attendance: 3 days/week.
- MLOps Core: Production model serving (Triton Inference Server, TorchServe, KServe, or Azure ML endpoints) behind REST/gRPC APIs, with end-to-end backend pipeline ownership. Exposure to tracking, model registry/versioning, drift detection, and production telemetry/monitoring.
- Computer Vision: Working exposure to CV/image data in production.
- Infrastructure & Cloud: Strong practical experience navigating cloud environments, strictly focused on Azure, specifically using AKS for deployment, Azure DevOps, and the Azure data stack, alongside managing/provisioning GPU compute resources.
- DevOps & Automation: Deep understanding of containerization (e.g., Docker and Kubernetes) and designing robust CI/CD pipelines for automated deployments.
- AI/ML Foundation: A solid conceptual understanding of AI/ML fundamentals to effectively communicate, troubleshoot, and collaborate with applied model developers.
- Upper-intermediate English level.

WHAT YOU WILL DO
- Resource & Cost Optimization: Lead GPU compute efficiency and infrastructure cost-reduction strategies by optimizing models to maximize camera throughput per GPU. Apply optimization techniques including quantization (FP16/INT8), pruning, TensorRT/ONNX conversion, dynamic batching, and GPU autoscaling on AKS.
- End-to-End Deployment: Own the complete lifecycle transition from AI/ML experimentation to reliable, high-performance production deployment.
- Infrastructure & Pipelines: Build, maintain, and scale robust ingestion and inference pipelines for high-volume image streams using Azure Data Factory, cloud storage, and automated CI/CD workflows.
- Edge & Cloud Deployment: Architect and manage large-scale cloud-based model inference environments, with secondary support for edge GPU deployment across specific edge use cases.
- System Stability & Monitoring: Implement robust production monitoring systems, build visibility dashboards, and set up data and concept drift detection to ensure ongoing model accuracy and system reliability.
- Model Lifecycle Management: Manage experiment tracking and model versioning to ensure full reproducibility and traceability of all models in production.
- Cross-Functional Collaboration: Partner closely with data scientists and AI researchers to translate experimental models into robust, production-ready solutions.

PERKS AND BENEFITS
- Professional growth: Mentorship, TechTalks, and personalized growth roadmaps.
- Competitive compensation: USD-based pay with education, fitness, and team activity budgets.
- Exciting projects: Modern solutions with Fortune 500 and top product companies.
- Flextime: Flexible schedule with remote and office options.

Similar Jobs

46 Minutes Ago
In-Office or Remote
10003, New York, NY, USA
114K-180K Annually
Entry level
114K-180K Annually
Entry level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Serve as a pre-sales technical expert for DX, partnering with Account Executives throughout the sales cycle. Lead technical discovery, evaluations, proof-of-concepts, pilots, product demonstrations, and solution design involving APIs and client engineering workflows. Advise prospects on deployment and analytics integrations, translate technical concepts into business value, and relay customer feedback to Product and Engineering teams. Manage technical follow-ups across multiple opportunities.
Top Skills: APIsCi/CdGitGithub CliRestRubyRuby On RailsSQL
46 Minutes Ago
In-Office or Remote
10003, New York, NY, USA
123K-193K Annually
Mid level
123K-193K Annually
Mid level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Drive enterprise adoption of Atlassian’s Rovo AI platform through discovery workshops, custom agent design, connector configuration, production deployment, and customer enablement. Partner with enterprise teams to identify valuable AI use cases, translate business needs into technical solutions, measure outcomes, and support independent scaling. Collaborate with account teams, CSMs, product, engineering, and AI teams to improve adoption and customer value. Travel up to 15% domestically and internationally.
Top Skills: Ai AgentsAtlassianConfluenceGitGoogle DriveJIRAPrompt EngineeringRovoRovo StudioSharepointSlackThird-Party Connectors
46 Minutes Ago
In-Office or Remote
10003, New York, NY, USA
Entry level
Entry level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Responsible for acquiring new enterprise customers for Atlassian. The role is a remote, full-time sales position available in select U.S. locations within Atlassian’s distributed-first work model.

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account