Lead the technical architecture for Spotify's Agent Engine, integrating AI systems and improving agent-based experiences while guiding platform consolidation efforts.
Spotify’s Personalization team is building the next generation of intelligent listening experiences. Across surfaces like DJ, Search, AI Playlists, and Home, we’re evolving from standalone features into a unified, agent-powered platform.
Generative AI is reshaping how we build products and systems. As part of this shift, we’re creating a shared Agent Engine that powers agent-based experiences across Spotify. You’ll join a cross-functional group of engineers, researchers, and product partners working at the intersection of distributed systems, machine learning, and user experience to shape how millions of listeners interact with audio every day.
What You'll Do
- Lead the technical architecture of Spotify’s Agent Engine, the shared runtime that powers agent-based experiences across the platform
- Guide the transition of existing agent-powered features into a unified system, balancing speed, reliability, and real-world product constraints
- Design how internal systems can be exposed as agent capabilities, enabling seamless integration across recommendations, search, catalog, and more
- Build and improve evaluation systems that help teams measure quality, reliability, and user impact with confidence
- Partner with research and machine learning teams to define what belongs in system design versus model capabilities
- Explore and prototype new approaches to agent-based systems, and bring successful ideas into production at scale
- Support best practices in building production-ready AI systems, including experimentation, observability, and performance optimization
- Contribute to technical standards that help teams move faster while maintaining security and reliability
- Stay connected to advances in the AI and machine learning community, and apply relevant ideas to Spotify’s products
Who You Are
- You have experience building and scaling production AI systems, including systems powered by large language models
- You are comfortable working across system design, infrastructure, and machine learning concepts, and enjoy connecting these areas
- You have experience with areas such as agent orchestration, LLM infrastructure, evaluation systems, or data pipelines for machine learning
- You have worked on platform or consolidation efforts that bring multiple systems or teams together
- You are able to make progress in ambiguous problem spaces and bring structure to open-ended challenges
- You communicate clearly and work well with engineering, product, and research partners across different levels of the organization
- You stay informed on developments in AI and are motivated to apply new ideas in practical ways
- You take a pragmatic approach to building, using prototypes and iteration to move ideas forward
- You take ownership of outcomes and proactively manage risks, trade-offs, and expectations
Where You'll Be
- We offer you the flexibility to work where you work best! For this role, you can be within the North America region as long as we have a work location
- This team operates within the Eastern Standard time zone for collaboration
The United States base range for this position is $281,196 - $401,709 plus equity. The benefits available for this position include health insurance, six month paid parental leave, 401(k) retirement plan, monthly meal allowance, 23 paid days off, 13 paid flexible holidays, paid sick leave. These ranges may be modified in the future.
Spotify is an equal opportunity employer. You are welcome at Spotify for who you are, no matter where you come from, what you look like, or what’s playing in your headphones. Our platform is for everyone, and so is our workplace. The more voices we have represented and amplified in our business, the more we will all thrive, contribute, and be forward-thinking! So bring us your personal experience, your perspectives, and your background. It’s in our differences that we will find the power to keep revolutionizing the way the world listens.
At Spotify, we are passionate about inclusivity and making sure our entire recruitment process is accessible to everyone. We have ways to request reasonable accommodations during the interview process and help assist in what you need. If you need accommodations at any stage of the application or interview process, please let us know - we’re here to support you in any way we can.
Spotify transformed music listening forever when we launched in 2008. Our mission is to unlock the potential of human creativity by giving a million creative artists the opportunity to live off their art and billions of fans the chance to enjoy and be passionate about these creators. Everything we do is driven by our love for music and podcasting. Today, we are the world’s most popular audio streaming subscription service.
Top Skills
Agent Orchestration
AI
Data Pipelines
Large Language Models
Machine Learning
Spotify New York, New York, USA Office
4 World Trade Center, New York, NY, United States, 10007
Similar Jobs
Other • Real Estate • PropTech
As a Senior Machine Learning Engineer, you will architect and build scalable ML infrastructure, influence technical direction, mentor engineers, and ensure effective production deployment, collaborating closely with AI teams.
Top Skills:
Agents SdkAirflowAWSDatabricksLangchainLanggraphMachine LearningPythonSpark
eCommerce
As a Machine Learning Engineer, you'll create and optimize production-ready ML solutions, manage the ML lifecycle, and conduct experiments.
Top Skills:
Large Language ModelsMachine LearningMachine Learning AlgorithmsPersonalizationPythonRecommendationsTransformers
_0.png)
Productivity • Software • Conversational AI
The Machine Learning Engineer will develop and maintain scalable ML systems, collaborate across teams, and innovate solutions for real-time applications to enhance customer experiences.
Top Skills:
AirflowAWSAzureDockerDynamoDBEmrFlinkGCPJavaKafkaKubeflowKubernetesMetaflowMlflowOpensearchPythonSagemakerSnowflakeSparkSQL
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
