About the Role
We are looking for a Senior AI/ML Engineer to lead the design and delivery of production-grade machine learning systems and drive the maturity of our ML engineering and MLOps capabilities. In this role, you will own critical ML workstreams end to end, make key architectural decisions, mentor other engineers, and collaborate closely with cross-functional teams to ensure ML solutions are scalable, reliable, and aligned with business objectives. The ideal candidate brings deep technical expertise, proven production experience, and the ability to influence technical direction across the team.
Key Responsibilities
Lead the design, development, and production deployment of complex machine learning systems across multiple domains (NLP, computer vision, recommendation, forecasting, etc.).
Own the end-to-end ML lifecycle from problem framing and data strategy through model development, validation, deployment, and monitoring.
Architect scalable, fault-tolerant ML pipelines using modern orchestration and serving frameworks.
Drive the adoption and maturity of MLOps practices including CI/CD for ML, automated retraining, model registry, and governance.
Define and enforce engineering standards for model development, testing, code quality, and documentation.
Evaluate and introduce new tools, frameworks, and techniques to improve model performance, pipeline efficiency, and developer productivity.
Collaborate with data engineers, platform engineers, and product teams to align ML infrastructure with organizational goals.
Mentor and provide technical guidance to mid-level and junior engineers.
Conduct design reviews, code reviews, and architectural assessments for ML systems.
Contribute to technical roadmap planning and communicate tradeoffs and recommendations to engineering leadership.
Identify and mitigate risks related to data quality, model drift, bias, and security in production ML systems.
Required Qualifications
Bachelor’s or Master’s degree in Computer Science, Mathematics, Statistics, or a related field. PhD is a plus.
5–8 years of professional experience in ML engineering, applied ML research, or a closely related role with significant production delivery.
Deep expertise in Python and advanced proficiency with ML frameworks such as TensorFlow, PyTorch, or JAX.
Extensive experience designing and operating production ML pipelines at scale.
Strong knowledge of MLOps principles and tools including MLflow, Kubeflow, Airflow, Argo Workflows, or similar.
Proven experience with cloud-native ML platforms (AWS SageMaker, Azure ML, GCP Vertex AI) and infrastructure-as-code practices.
Experience with model serving at scale using frameworks such as TensorFlow Serving, Triton, BentoML, or Seldon.
Strong understanding of distributed computing, data engineering, and scalable system design.
Experience with monitoring, observability, and governance for production ML systems.
Demonstrated ability to mentor engineers and influence technical direction.
Excellent communication skills with the ability to present technical concepts to both technical and non-technical audiences.
Preferred Qualifications
Experience with LLM-based systems, RAG pipelines, or agentic AI architectures.
Experience with feature platforms (Feast, Tecton) and data quality frameworks (Great Expectations, Deequ).
Familiarity with model explainability and fairness tools (SHAP, LIME, Fairlearn).
Experience with real-time ML serving and streaming data pipelines (Kafka, Flink).
Contributions to open-source ML/MLOps projects.
Experience with GPU cluster management and cost optimization for training workloads.
Salary Range
US East/West Coast: $130,200 - $173,600
US Remote: $110,700 - $147,600
Disclaimer: The base salary range is a guideline and may vary based on factors such as candidate experience, specialized skills, and geographical location. Actual compensation may include additional benefits and bonuses.
Perks And Benefits Of Working With Us
Unlimited PTO.
Please ask us about our very generous parental leave, much above industry standards!.
Entrepreneurial culture where pushing limits and taking risks is everyday business.
Open communication with management and company leadership.
Small, dynamic teams = massive impact.
Medical, Dental and Vision coverage for employees.
Access to Disability & Life insurance.
Mental health and wellbeing support
Annual bonus program
Employer Stock Purchase Program (ESPP)
Yearly Team building experiences
Mentorship and sponsorship opportunities
Manager resources and support
We are an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or any other protected characteristic.
Similar Jobs
What you need to know about the NYC Tech Scene
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

