Highlight AI Logo

Highlight AI

Senior ML Engineer

Reposted 7 Days Ago
In-Office
San Francisco, CA
200K-350K Annually
Senior level
In-Office
San Francisco, CA
200K-350K Annually
Senior level
The Senior ML Engineer will design and build ML systems, optimize ML pipelines, implement RAG systems, collaborate with engineering teams, and contribute to ML infrastructure. Requires experience in shipping production ML systems and proficiency in modern ML tools.
The summary above was generated by AI

Highlight is building a shared intelligence layer for the modern workforce. Highlight unifies context across every person and tool on your team, seamlessly bridging information silos. It evolves with your organization to proactively route knowledge and reliably automate workflows.

The Role

We're hiring a Senior ML Engineer to help build the AI systems that power Highlight. You will work across the full ML stack: data pipelines, model training, retrieval, ranking, evals, and deployment. You will ship features that make Highlight feel like magic. This is a hands on IC role where you will own critical systems end to end and collaborate closely with our Head of AI Engineering to scale our ML capabilities.

You will thrive here if you love shipping production ML systems, obsess over output quality, and want to work on hard problems with real user impact. We move fast, hold a high bar, and believe the best ideas win regardless of title.

Note: this is an on site role, requiring five days a week in our office.

Job Responsibilities

  • Design, build, and optimize ML pipelines for context retrieval, action detection, and output generation

  • Implement and iterate on RAG systems, ranking models, and prompt engineering to improve quality

  • Build comprehensive evals and monitoring to measure and improve ML system performance

  • Investigate alternative models and fine tuning approaches for our heavy background processing workloads, implementing better systems to increase quality while improving cost efficiency

  • Collaborate with Backend and Product Engineering to ship AI powered features

  • Contribute to ML infrastructure decisions and best practices across the engineering org

  • Stay current on LLM advances, retrieval techniques, and ML tooling; bring insights back to the team

Profile

We’re looking for someone who is interested in building the AI user experience for the future. We punch above our weight so we value extreme ownership, accountability, and proactiveness. The ideal candidate is a master craftsman who enjoys building great products with LLMs at scale.

You are a good fit if you have:

  • 4+ years in ML/AI engineering, with significant experience shipping production systems

  • Strong software engineering fundamentals: you write clean, maintainable code

  • Deep experience with retrieval, ranking, RAG, or search systems at scale

  • Hands on proficiency with PyTorch, vector databases, and modern ML infrastructure

  • Experience with LLM applications (prompt engineering, fine tuning, eval frameworks)

  • Product thinker: understands how to connect great ML products to constraints, evals, and modeling when building them

  • A bias toward action: you ship fast, measure rigorously, and iterate based on data

  • Ownership mentality (no task is too small for you) – it’s all hands on deck here and we need everyone rowing the boat.

  • Excellent communication skills and a collaborative mindset – we’re extremely lean so we’re looking for a team player who works well with others.

  • Type-A tendencies: maybe you’re extremely detail-oriented. Or maybe you take pride in shipping high-quality products. Whatever it is you do, you give it your all.

  • Must be based in or willing to relocate to SF – although we’re flexible with days off & schedules, we have a 100% in-office culture during the week.

And even if you don’t fall neatly into any of these buckets, we’re looking for scrappy and motivated self-starters above all. Hustle is expected, grit is required.

Perks

  • Competitive salary and generous equity package

  • Health, dental, and vision insurance

  • Flexible PTO and parental leave

  • Paid team lunches during the week

  • Relocation package

Top Skills

AI
Data Pipelines
Eval Frameworks
Llm Applications
Ml
Model Training
Modern Ml Infrastructure
Prompt Engineering
PyTorch
Rag
Ranking
Retrieval
Vector Databases

Similar Jobs

7 Days Ago
In-Office or Remote
United States
164K-194K Annually
Senior level
164K-194K Annually
Senior level
Fintech • Machine Learning • Payments • Social Impact • Software • Financial Services
As a Senior Machine Learning Engineer, you'll design and manage ML infrastructure, work with Data Science to implement models, and oversee system health and reliability.
Top Skills: AWSCloudFormationDatabricksDockerDynamoDBKafkaKubernetesPythonPyTorchSagemakerScikit-LearnSnowflakeSQLTensorFlowTerraform
2 Days Ago
In-Office or Remote
92K-164K Annually
Senior level
92K-164K Annually
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Responsible for shipping production ML systems, designing robust architectures, maintaining data pipelines, and collaborating to translate product goals into ML solutions.
Top Skills: AzureC#Ci/CdKubernetesLlmsMlopsPython
2 Days Ago
Remote or Hybrid
201K-352K Annually
Senior level
201K-352K Annually
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
The role involves building cloud-based AI/ML solutions, collaborating with teams, and ensuring the delivery of quality software to enhance enterprise services.
Top Skills: AIJavaMlPython

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account