Sunset Logo

Sunset

Machine Learning Engineer

Posted 8 Hours Ago
Be an Early Applicant
In-Office
New York, NY, USA
Mid level
In-Office
New York, NY, USA
Mid level
Build and productionize ML systems for de-identification: improve NER, entity resolution, extraction, and document understanding. Drive error analysis, dataset creation, experiments, evaluation, safe rollouts, inference optimization, and active-learning/LLM-assisted pipelines to improve precision, recall, and utility in live pipelines.
The summary above was generated by AI
About Sunset

At its core, Sunset was founded to help founders. We started by supporting startups through shutting down, but we have since expanded into unlocking a new revenue stream for all types of businesses.

In 2025, we had a unique insight: the data every company generates each day through collaboration, communication, and building is some of the most valuable training data in the world. Public and synthetic data can only get frontier models so far, so the next generation of model progress depends on real, proprietary data grounded in how actual businesses operate. We are a primary source of it, partnering directly with the frontier AI labs building what comes next.

Why Join Sunset Now
  • We have scaled from $0 to a multi-eight-figure run rate in a matter of months

  • We have raised from top-tier investors, including Floodgate, Afore, Ludlow, and Hustle Fund

  • We are small enough that you will carry outsized responsibility and grow as quickly as the company does

  • You will partner with and build for some of the fastest and most important companies in the world

  • You will help build a massive, category-defining business from the ground floor

The Role

Sunset turns sensitive internal enterprise data into de-identified datasets without destroying the structure and meaning that make the data valuable. The data does not arrive in one clean modality. It spans messages, documents, tables, files, images, metadata, and provider-specific structures, with important context distributed across all of them.

You will improve how well our system understands and protects that data. Your initial scope will be a prioritized subset of named-entity recognition, entity and identity resolution, structured extraction, classification, semantic review, or other model-backed parts of the de-identification pipeline. We do not expect one person to be an expert in every modality. The goal is measurable improvement in the areas you own: better precision, recall, F1, high-risk coverage, and preserved data utility across the failure modes that matter.

This is an applied, production-facing ML role. You will study errors, form hypotheses, build datasets and experiments, improve or replace models, and ship the result into a live pipeline. Evaluation, reproducibility, observability, and safe releases matter because they let us identify, ship, and verify meaningful model improvements in production.

What You'll Do
  • Own and improve NER, entity resolution, structured or tabular detection, document understanding, semantic review, or related de-identification systems

  • Transform model failures and capability ceilings into a prioritized improvement roadmap

  • Design active-learning loops that combine model sweeps, LLM-assisted review, clustering, and uncertainty signals to identify the examples most worth hand-labeling

  • Build representative datasets and benchmarks, and use decision-relevant metrics to reveal strengths, weaknesses, uncertainty, and failure costs

  • Choose and combine deterministic rules, classical ML, fine-tuning, embeddings, multimodal models, and LLM-based approaches based on the problem and evidence

  • Design experiments, tune thresholds, analyze precision-recall and utility tradeoffs, and explain which changes are real, uncertain, or limited to particular conditions

  • Productionize improvements with reproducible artifacts, evaluation evidence, runtime instrumentation, and safe rollout

  • Optimize inference cost, latency, and throughput without hiding regressions in quality or high-risk recall

  • Build high-fidelity evaluation environments with seeded failure modes and programmatic verifiers that expose subtle regressions

  • Build reliable model- or agent-based harnesses with bounded behavior and explicit output verification when the problem calls for them

  • Partner with Applied Science on measurement and calibration, Data and Product Engineering on pipeline and review systems, and Security and Quality on acceptable risk

  • Use AI engineering tools deeply to accelerate research, implementation, error analysis, and evaluation while verifying their output

What Success Looks Like
  • Model improvements generalize beyond the examples used to develop them and hold up in replay, shadow, and production evidence

  • Priority modalities and entity classes show credible improvements in precision, recall, F1, or other decision-relevant quality measures

  • High-risk misses decline without unacceptable over-redaction or loss of useful structure

  • New formats and modalities can be covered without relying on brittle one-off fixes

  • Improvements reduce meaningful delivery risk, review or rework burden, or loss of data utility rather than moving only an isolated benchmark

  • The team can explain why a model changed, where it improved or regressed across consequential failure modes and data segments, and whether the change should ship

  • The path from error discovery to a trustworthy production improvement becomes faster and more repeatable

  • Quality gains remain inside acceptable inference-cost, latency, and operational constraints

You Might Thrive Here If
  • You have 3+ years of professional machine learning or software engineering experience, including improving models in production

  • You have startup experience, enjoy broad ownership, and thrive when requirements are evolving or incomplete

  • You use modern AI tools fluently and verify their output

  • You have personally moved model quality through error analysis, data work, experimentation, implementation, deployment, and iteration

  • You have a strong grasp of precision, recall, F1, calibration, thresholding, class imbalance, imperfect labels, distribution shift, and representative evaluation

  • You are an applied engineer first: a strong Python and software engineer who can work inside data pipelines and production systems, not only notebooks

  • You have a bias toward action while maintaining scientific and engineering rigor

  • You are curious and stay current with relevant state-of-the-art methods

  • You choose techniques based on the shape of the problem and can combine deterministic, statistical, neural, and LLM-based approaches

  • You communicate uncertainty and tradeoffs clearly to scientists, engineers, and people making delivery or risk decisions

This Role May Not Be for You If
  • You want to focus on research novelty without owning measurable production improvement

  • You prefer optimizing one aggregate benchmark without investigating consequential failure modes, data segments, and failure costs

  • You want data preparation, evaluation, deployment, and production diagnosis to belong entirely to other teams

  • You reach for a larger model before understanding the errors, constraints, and simpler alternatives

  • You do not want AI tools to be part of your daily engineering and research workflow

Bonus
  • Experience with NER, entity resolution, information extraction, document understanding, multimodal systems, or privacy-preserving ML

  • Experience with hyperparameter tuning, data augmentation, model merging, ensembles, knowledge distillation, or multimodal model training

  • Experience fine-tuning or adapting transformer, GLiNER, embedding, vision-language, or small specialized models

  • Experience with active learning, uncertainty sampling, weak supervision, human-in-the-loop review, or LLM-assisted evaluation pipelines

  • Experience building goldens, adversarial corpora, replay systems, model bakeoffs, agentic harnesses, or programmatic evaluation environments

  • Experience with difficult ML or labeling problems

  • Experience with ONNX Runtime, TensorRT, model pruning, quantization, or other CPU/GPU inference optimization

  • Experience with sensitive enterprise data or other high-trust production systems

  • Experience with synthetic data generation and managing the synth-to-real gap

HQ

Sunset New York, New York, USA Office

Dumbo, New York, NY, United States, 11201

Similar Jobs

3 Days Ago
In-Office
New York, NY, USA
200K-250K Annually
Senior level
200K-250K Annually
Senior level
Artificial Intelligence • Fintech • Financial Services
Design, build, and productionize core AI systems for document understanding, forecasting, and agentic workflows. Handle messy data ingestion, evaluation, monitoring, anomaly detection, entity reconciliation, and backtesting to deliver reliable, product-focused ML solutions.
Top Skills: Agentic WorkflowsArimaDocument UnderstandingGradient-Boosted ModelsInformation ExtractionLlmProphetRagRetrieval SystemsRolling-Origin BacktestingTime-Series Forecasting
3 Days Ago
Hybrid
New York, NY, USA
195K-343K Annually
Senior level
195K-343K Annually
Senior level
Artificial Intelligence • Cloud • Machine Learning • Mobile • Software • Virtual Reality • App development
Design and deliver generative AI and computer vision models and on-device inference for consumer AR experiences. Prototype research advances, optimize models (compression, quantization, distillation), collaborate across teams, and productionize scalable inference pipelines for mobile and wearable platforms.
Top Skills: ArComputer VisionCpu OptimizationDeep LearningDiffusion ModelsGenerative ModelingGpu OptimizationJaxMl Inference PipelinesMlxModel CompressionModel DistillationNeural NetworksNpu OptimizationPyTorchQuantizationScikit-LearnTensorFlow
3 Days Ago
In-Office
139K-232K Annually
Senior level
139K-232K Annually
Senior level
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Lead development of an AI-ready research data ecosystem for vaccine R&D: design integrated data architectures, automate ingestion and transformation pipelines, define semantic/metadata frameworks, build knowledge graphs and RAG systems, and develop multimodal predictive and translational ML models. Provide technical leadership, mentor teams, and collaborate across scientists, bioinformatics, and enterprise data organizations to accelerate AI-driven vaccine discovery and decision-making.
Top Skills: Agentic AiCloudFoundation ModelsGenerative AiHigh-Performance ComputingKnowledge GraphsPythonPyTorchRetrieval-Augmented Generation (Rag)TensorFlow

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account