As a Senior Data Engineer, you'll build and optimize ETL pipelines, design scalable data systems, and collaborate with Data Scientists on data transformation.
About Chartmetric
Chartmetric, Inc. is a 10-year-old startup specializing in music data analytics. We are trusted by Universal MusicGroup, Sony, Warner, and Apple Music, as well as hundreds of other music companies and industry professionals. Our team has created a self-service data dashboard for the music industry to better understand the activity happening around artists. Together, we combine hundreds of thousands of real-time data points across iTunes, Spotify, YouTube, Google, Amazon, X, and others through our beautifully designed tool in order to make sense of the increasingly complex landscape of the music industry.
What you'll do
- Build and optimize ETL pipelines processing data for 10M+ artists, 100M+ tracks, 15M+ playlists, and comprehensive music industry metrics
- Design scalable data ingestion systems to integrate emerging streaming platforms and social media services into our analytics infrastructure
- Architect and maintain our multi-cloud data ecosystem spanning AWS RDS, Elasticsearch, and Snowflake
- Develop production-ready Python applications and complex PostgreSQL queries deployed across distributed systems
- Collaborate with Data Scientists to transform raw music data into actionable insights that drive strategic decisions for artists, labels, and industry professionals
- This position is hybrid and will be in office 3/4 times a week in our San Mateo or New York office
Who You Are
- 6+ years of hands-on experience building production data systems, preferably in high-volume consumer or entertainment industries
- Expert-level proficiency in Python, PostgreSQL, Apache Airflow, Snowflake, Elasticsearch, Apache Spark, and AWS ecosystem
- Proven track record of designing fault-tolerant, high-throughput data pipelines handling millions of records daily
- Strong communication skills with ability to translate complex technical concepts to cross-functional stakeholders
- Bachelor’s degree in Computer Science, Data Engineering, or equivalent practical experience
- Thrives in dynamic startup environments with rapidly evolving requirements and tight delivery timelines
- Bonus: Experience with music industry data, streaming APIs, or social media analytics platforms
What We Offer
- Competitive salary and equity package
- Comprehensive health, dental, and vision insurance
- Opportunity to shape developer experience across the organization
- Access to cutting-edge tools and technologies
Team Culture
- We believe that great developer experiences lead to better products and happier teams. Our DevOps/DX team operates as enablers and force multipliers, working collaboratively to remove friction from the development process. We value automation, measurement, and continuous improvement, always asking "how can we make this better for our developers?"
Top Skills
Apache Airflow
Spark
AWS
Elasticsearch
Postgres
Python
Snowflake
Similar Jobs
Fintech • Machine Learning • Payments • Software • Financial Services
As a Senior Data Engineer, you'll design and develop solutions, work with Agile teams, and leverage big data technologies for complex problems.
Top Skills:
AWSCassandraEmrGCPGurobiHadoopHiveJavaKafkaLinuxMapreduceAzureMongodbMySQLNoSQLOpen Source RdbmsPythonRedshiftScalaSnowflakeSparkUnix
AdTech • Consumer Web • Digital Media • eCommerce • Marketing Tech
The Senior Data Engineer will build and optimize data integration pipelines, ensure data quality, and collaborate with stakeholders to implement business requirements.
Top Skills:
Apache BeamApache KafkaSparkGoogle Cloud PlatformPub/SubPythonSQL
Automotive • Cloud • Greentech • Information Technology • Other • Software • Cybersecurity
Seeking a Senior Data Engineer to design and optimize data pipelines, ensuring data quality and supporting advanced analytics. Responsibilities include building data architectures, developing automated testing, and collaborating with stakeholders.
Top Skills:
Apache AirflowAWSAzureAzure SynapseDbtHadoopJavaKafkaKinesisPytestPythonPyTorchRedshiftScalaScikit-LearnSeleniumSnowflakeSparkSQLTensorFlow
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
