Sesame (sesame.com) Logo

Sesame (sesame.com)

Research Engineer

Reposted One Month Ago
In-Office
New York, NY, USA
190K-320K Annually
Expert/Leader
In-Office
New York, NY, USA
190K-320K Annually
Expert/Leader
The ML Engineer will design, build, and automate evaluation pipelines, curate datasets, train and deploy voice models, monitor performance, and manage production code across various stages of the machine learning lifecycle. They will also collaborate closely with research and infrastructure teams to enhance user-facing systems.
The summary above was generated by AI

About Sesame

Sesame believes in a future where computers are lifelike - with the ability to see, hear, and collaborate with us in ways that feel natural and human. With this vision, we're designing a new kind of computer, focused on making voice agents part of our daily lives. Our team brings together founders from Oculus and Ubiquity6, alongside proven leaders from Meta, Google, and Apple, with deep expertise spanning hardware and software. Join us in shaping a future where computers truly come alive.

About the Role

New and novel approaches are needed to realize all of our product goals. As a Research engineer at Sesame, you are a research-oriented person with experience in NLP, Speech, and/or Computer Vision with a focus on deep learning. You are up to date on recent papers and approaches and you have the creativity and the intuition to come up with new solutions based on the application at hand.


Responsibilities:
  • Own evaluation pipelines — design, build, and automate offline and live evals that keep our speech and multimodal models honest in production.

  • Harness the data — create tooling for safe, versioned, privacy-aware dataset curation and discovery.

  • Ship models, not slide decks — partner with research and infra to prototype, train, and deploy state-of-the-art voice models that power Sesame’s real-time companion experience.

  • Squeeze silicon — scale training and inference for LLM-class workloads; chase latency, throughput, and cost until the graphs flatten.

  • Wire up monitoring and live evals — surface quality regressions before users or PMs notice.

  • Move at startup speed — take ideas from whiteboard to production in days, not quarters; leave a clean trail of tests and dashboards behind.

Required Qualifications:
  • Expert-level PyTorch.

  • Proven software engineer who loves ML; comfortable writing production code across the stack.

  • Hands-on experience training or fine-tuning large language or other large-scale models with a variety of techniques.

  • Evaluation expert — you’ve designed metrics and harnesses that actually predict user happiness.

  • Deep knowledge of the ML lifecycle: dataset ops, training pipelines, eval frameworks, deployment, and monitoring.

  • History of shipping complex projects to production—especially user-facing, online ML systems—despite shifting requirements and surprise roadblocks.

  • High agency and the judgment to know when to sprint solo vs. pull in the squad.

  • Track record of setting technical direction, driving consensus, and partnering smoothly with product, infra, and research.

Sesame is committed to a workplace where everyone feels valued, respected, and empowered. We welcome all qualified applicants, embracing diversity in race, gender, identity, orientation, ability, and more. We provide reasonable accommodations for applicants with disabilities. Contact [email protected] for assistance.

Full-time Employee Benefits: 

  • 401 (k) max employer match: 3.5% of compensation

  • 100% employer-paid health, vision, and dental benefits for you and your dependents

  • Unlimited PTO and sick time

  • Flexible spending account with employer matching up to $1,650/year (medical FSA)

  • Guardian Employee Assistance Program (EAP)

  • Opportunity to share in the company's success with competitive stock options

Benefits do not apply to contingent/contract workers.

HQ

Sesame (sesame.com) New York, New York, USA Office

New York, NY, United States

Similar Jobs

2 Days Ago
Remote or Hybrid
New York, NY, USA
165K-310K Annually
Senior level
165K-310K Annually
Senior level
Artificial Intelligence • Machine Learning • Software
Design, optimize, and deploy large language model training and post-training pipelines. Improve model quality through fine-tuning, reinforcement learning, preference optimization, evaluation, and experimentation. Build PyTorch-based infrastructure, optimize distributed multi-GPU training, diagnose performance and convergence issues, and develop production-ready AI systems. Collaborate with researchers, infrastructure engineers, platform teams, and customers while contributing to open-source projects and reusable training capabilities.
Top Skills: CudaDeepspeedDistributed TrainingDpoFsdpGpu Performance OptimizationGrpoHugging Face TransformersLightning FabricMegatron-LmMixed PrecisionMulti-Gpu SystemsNvidia MoltPeftPpoPythonPyTorchReinforcement LearningReward ModelingRlhfSglangSupervised Fine-TuningTensorrtTransformer-Based Language ModelsTritonTrlVllm
2 Days Ago
Remote or Hybrid
New York, NY, USA
165K-310K Annually
Entry level
165K-310K Annually
Entry level
Artificial Intelligence • Machine Learning • Software
Develop and post-train deep learning models while building systems, tooling, and workflows for training, evaluation, debugging, and deployment. Contribute to open-source projects, distributed AI infrastructure, backend services, and developer platforms. Collaborate with research, product, infrastructure, and customer teams to solve complex technical problems, prototype ideas, and productionize successful experiments.
Top Skills: Cloud InfrastructureCudaDeepspeedDistributed SystemsFsdpHugging FaceLightning AiNvidia MoltPyTorchSglangTritonVllm
4 Days Ago
In-Office or Remote
United States
110K-170K Annually
Mid level
110K-170K Annually
Mid level
Software • Cybersecurity
Build and scale secure automated patching infrastructure for open-source vulnerabilities. Develop Rust and Unix-based CLI tools, package-manager integrations, APIs, testing tools, and developer-facing remediation workflows. Debug ecosystem-specific issues, contribute to JavaScript, React, and TypeScript frontends, and collaborate with security researchers to deliver certified packages and high-quality patches at scale.
Top Skills: APIsCi/CdJavaScriptLinuxNode.jsNpmPnpmReactRustTypescriptUnixYarn

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account