Highlight AI Logo

Highlight AI

Senior ML Engineer

Reposted 23 Days Ago
In-Office
San Francisco, CA
200K-350K Annually
Senior level
In-Office
San Francisco, CA
200K-350K Annually
Senior level
The Senior ML Engineer will design and build ML systems, optimize ML pipelines, implement RAG systems, collaborate with engineering teams, and contribute to ML infrastructure. Requires experience in shipping production ML systems and proficiency in modern ML tools.
The summary above was generated by AI

Highlight is building a shared intelligence layer for the modern workforce. Highlight unifies context across every person and tool on your team, seamlessly bridging information silos. It evolves with your organization to proactively route knowledge and reliably automate workflows.

The Role

We're hiring a Senior ML Engineer to help build the AI systems that power Highlight. You will work across the full ML stack: data pipelines, model training, retrieval, ranking, evals, and deployment. You will ship features that make Highlight feel like magic. This is a hands on IC role where you will own critical systems end to end and collaborate closely with our Head of AI Engineering to scale our ML capabilities.

You will thrive here if you love shipping production ML systems, obsess over output quality, and want to work on hard problems with real user impact. We move fast, hold a high bar, and believe the best ideas win regardless of title.

Note: this is an on site role, requiring five days a week in our office.

Job Responsibilities

  • Design, build, and optimize ML pipelines for context retrieval, action detection, and output generation

  • Implement and iterate on RAG systems, ranking models, and prompt engineering to improve quality

  • Build comprehensive evals and monitoring to measure and improve ML system performance

  • Investigate alternative models and fine tuning approaches for our heavy background processing workloads, implementing better systems to increase quality while improving cost efficiency

  • Collaborate with Backend and Product Engineering to ship AI powered features

  • Contribute to ML infrastructure decisions and best practices across the engineering org

  • Stay current on LLM advances, retrieval techniques, and ML tooling; bring insights back to the team

Profile

We’re looking for someone who is interested in building the AI user experience for the future. We punch above our weight so we value extreme ownership, accountability, and proactiveness. The ideal candidate is a master craftsman who enjoys building great products with LLMs at scale.

You are a good fit if you have:

  • 4+ years in ML/AI engineering, with significant experience shipping production systems

  • Strong software engineering fundamentals: you write clean, maintainable code

  • Deep experience with retrieval, ranking, RAG, or search systems at scale

  • Hands on proficiency with PyTorch, vector databases, and modern ML infrastructure

  • Experience with LLM applications (prompt engineering, fine tuning, eval frameworks)

  • Product thinker: understands how to connect great ML products to constraints, evals, and modeling when building them

  • A bias toward action: you ship fast, measure rigorously, and iterate based on data

  • Ownership mentality (no task is too small for you) – it’s all hands on deck here and we need everyone rowing the boat.

  • Excellent communication skills and a collaborative mindset – we’re extremely lean so we’re looking for a team player who works well with others.

  • Type-A tendencies: maybe you’re extremely detail-oriented. Or maybe you take pride in shipping high-quality products. Whatever it is you do, you give it your all.

  • Must be based in or willing to relocate to SF – although we’re flexible with days off & schedules, we have a 100% in-office culture during the week.

And even if you don’t fall neatly into any of these buckets, we’re looking for scrappy and motivated self-starters above all. Hustle is expected, grit is required.

Perks

  • Competitive salary and generous equity package

  • Health, dental, and vision insurance

  • Flexible PTO and parental leave

  • Paid team lunches during the week

  • Relocation package

Similar Jobs

Yesterday
Easy Apply
In-Office or Remote
2 Locations
Easy Apply
200K-230K Annually
Senior level
200K-230K Annually
Senior level
Artificial Intelligence • Hardware • Healthtech • Software
As a Senior Machine Learning Engineer, you'll design and develop workflows utilizing vision-language models, manage data pipelines, and collaborate with multiple teams to enhance model accuracy and efficiency.
Top Skills: Cloud Inference ApisPythonPyTorch
2 Days Ago
Hybrid
185K-225K Annually
Senior level
185K-225K Annually
Senior level
Digital Media • eCommerce • Gaming • Mobile • News + Entertainment
The Senior Machine Learning Engineer will develop advanced recommendation models, optimize machine learning algorithms, and collaborate with cross-functional teams to enhance user engagement across Crunchyroll's platforms.
Top Skills: Aws SagemakerDatabricksDockerMlflowPythonPyTorchScikit-LearnSparkTensorFlow
9 Days Ago
Hybrid
Senior level
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
The role involves enhancing a search-based question-answering platform through ranking features, algorithm frameworks, and performance metrics while collaborating with various teams to solve engineering challenges.
Top Skills: GoInformation RetrievalMachine LearningNatural Language Understanding

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account