Program Manager - Evaluations & Demos

Udio builds extraordinary AI experiences to empower musical artists and super fans. Pairing best-in-class AI models with groundbreaking partnerships across the music industry, Udio's mission is to champion musicians and expand how fans engage with their favorite music and artists. Udio is backed by leading lights from tech and music, including a16z, Redpoint, Hanwha, will.i.am, Steve Stoute, Kevin Wall, and many others. For more information, please visit udio.com.

We are looking for a Program Manager to lead two critical components of our generative AI development: the human listening program and the demo creation program. In this role, you will be the bridge between the art of music and the science of machine learning.

You will be responsible for building and managing a high-quality network of musical experts (musicians, producers, and composers) to critically listen to and rate our model outputs. Your mission is to translate "what sounds good" into structured, actionable data that our engineering and research teams can use to train the next generation of audio models. You will also handle crafting high quality AI music demos of top artists.

• Recruit & Curate: Build a diverse roster of domain experts across a wide range of genres (e.g., Classical, Jazz, Hip Hop, EDM, Pop, Rock).
• Onboarding & Training: Train evaluators on the music rater program and the specific acoustic qualities we are testing for.
• Operations: Manage scheduling, payment, and logistics for evaluators.

• Evaluation Framework: Design an intuitive evaluation framework that is easy to use for the experts while collecting valuable data for the modeling team.
• Refine Testing Strategies: Continuously refine testing methodologies to ensure we are effectively improving our music models.
• Genre-Specific Nuance: Adapt evaluation criteria to fit specific genres (e.g., evaluating "groove" in Funk vs. "dynamic range" in Orchestral music).

• Feedback Collation: Convert qualitative feedback into actionable insights for the modeling team.
• Feedback Presentation: Collaborate closely with the modeling team to present findings. You will be the voice of the musician.
• Quality Assurance: Monitor the quality of the data coming from your evaluators to ensure consistency and eliminate bias.

• Creative Expertise: Generate high quality, creative musical works for Artist demos
• Strategic Customization: Collaborate closely with the Partnerships teams to highlight how our technology can augment artists’ unique creative process.

• Musical Expertise: 4+ years of experience in the music industry (Producer, Audio Engineer, Composer, or Musicologist). You must have a deep understanding of music theory, song structure, and audio production terminology.
• Operational Experience: Proven ability to manage teams, contractors, and complex projects. You are organized, prompt, and can handle the logistics of managing 10+ freelance contributors.
• Analytical Mindset: Comfortable working with data. You can look at a spreadsheet of ratings and identify trends, outliers, and insights.
• NYC Network: A pulse on the local music community to facilitate recruitment.
• Communication: The ability to explain complex musical concepts to technical engineers, and complex technical requirements to artists.

• Experience at a record label or music tech company
• Experience launching or scaling artist-facing platforms or programs
• Strong technical skills or advanced experience with statistics
• Multi-lingual

• You’ll work directly with frontier music models shaping the future of music creation.
• You’ll have the autonomy to design our human listening infrastructure from the ground up, creating the gold standard for how AI music is evaluated.
• You’ll have access to cutting edge music creation technology.
• You’ll join a small, ambitious team where relationships, trust, and execution truly matter.

• Highly competitive salary and equity
  
• Quarterly productivity budget
  
• Flexible time off
  
• Productivity package, including ChatGPT Plus, Claude Code, and Copilot
  
• Top-notch private health, dental, and vision insurance for you and your dependents
  
• 401(k) plan options with 5% employer matching
  
• Concierge medical and primary care through One Medical and Rightway
  
• Mental health support from Spring Health
  
• Personalized life insurance, travel assistance, and many other perks

Udio’s success hinges on hiring great people and creating an environment where we can be happy, feel challenged, and do our best work.

Udio provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability

This role is eligible for a compensation package of base salary, equity, and benefits. The salary range for this role is $100,000 - $160,000. Actual salary may vary based on level, work experience, performance, and other factors evaluated during the hiring process.