As a Senior Data Engineer, you'll build ETL pipelines, design data ingestion systems, and maintain a multi-cloud ecosystem while collaborating with Data Scientists to transform data into business insights.
About Chartmetric
Chartmetric, Inc. is a 10-year-old startup specializing in music data analytics. We are trusted by Universal MusicGroup, Sony, Warner, and Apple Music, as well as hundreds of other music companies and industry professionals. Our team has created a self-service data dashboard for the music industry to better understand the activity happening around artists. Together, we combine hundreds of thousands of real-time data points across iTunes, Spotify, YouTube, Google, Amazon, X, and others through our beautifully designed tool in order to make sense of the increasingly complex landscape of the music industry.
What you'll do
- Build and optimize ETL pipelines processing data for 10M+ artists, 100M+ tracks, 15M+ playlists, and comprehensive music industry metrics
- Design scalable data ingestion systems to integrate emerging streaming platforms and social media services into our analytics infrastructure
- Architect and maintain our multi-cloud data ecosystem spanning AWS RDS, Elasticsearch, Clickhouse, and Snowflake
- Develop production-ready Python applications and complex PostgreSQL queries deployed across distributed systems
- Collaborate with Data Scientists to transform raw music data into actionable insights that drive strategic decisions for artists, labels, and industry professionals
- This position is hybrid and will be in office 3/4 times a week in our San Mateo or New York office
Who You Are
- 6+ years of hands-on experience building production data systems, preferably in high-volume consumer or entertainment industries
- Expert-level proficiency in Python, PostgreSQL, Apache Airflow, Clickhouse, Snowflake, Elasticsearch, Apache Spark, and AWS ecosystem
- Proven track record of designing fault-tolerant, high-throughput data pipelines handling millions of records daily
- Strong communication skills with ability to translate complex technical concepts to cross-functional stakeholders
- Bachelor’s degree in Computer Science, Data Engineering, or equivalent practical experience
- Thrives in dynamic startup environments with rapidly evolving requirements and tight delivery timelines
- Bonus: Experience with music industry data, streaming APIs, or social media analytics platforms
What We Offer
- Competitive salary and equity package
- Comprehensive health, dental, and vision insurance
- Opportunity to shape developer experience across the organization
- Access to cutting-edge tools and technologies
Team Culture
- We believe that great developer experiences lead to better products and happier teams. Our DevOps/DX team operates as enablers and force multipliers, working collaboratively to remove friction from the development process. We value automation, measurement, and continuous improvement, always asking "how can we make this better for our developers?"
Chartmetric New York, New York, USA Office
199 Water St., New York, United States
Similar Jobs
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Lead design and operation of large-scale data pipelines and data APIs. Build Spark/PySpark workflows on Databricks, optimize job performance, manage data quality and observability, and develop MCP servers and AI-agent integrations. Mentor engineers, define standards, support production incidents and on-call rotations, and collaborate with stakeholders to deliver scalable data platform products.
Top Skills:
Apache IcebergApi GatewayAWSAws LambdaAws Rds/AuroraAzureDatabricksDatadogDbtFastapiFivetranGCPGoogle BigqueryLlms/Ai AgentsMcp ServersMs Sql ServerMySQLOraclePostgresPysparkPythonS3SecretsmanagerSnowflakeSnsSparkSplunkSQLSqs
.png)
Cloud • Insurance • Payments • Software • Business Intelligence • App development • Big Data Analytics
Design, build, and optimize BigQuery-based data solutions and data models. Manage data storage, partitioning, clustering, ETL, and data quality. Collaborate with architects, data scientists, and engineers to deliver scalable, secure cloud data infrastructure and documentation; senior hires provide technical leadership, code review, and process improvement.
Top Skills:
Ansi Sql)BigQueryConfluenceGoogle Cloud Platform (Gcp)JIRAPythonSql (Bigquery Sql
Cloud • Information Technology • Machine Learning
Own and evolve the data lake and analytics stack powering fleet observability. Build and maintain scalable ETL/ELT pipelines, operate data lake infrastructure (Iceberg, Trino, Airflow, Spark, Superset), produce analytics and executive reporting, create dashboards and runbooks, and implement data governance and observability.
Top Skills:
Apache AirflowApache HudiApache IcebergSparkApache SupersetAWSAzureDelta LakeEtl/EltGCPJavaManaged DatabasesNoSQLObject StoragePythonScalaSQLTrino
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
