Senior Data Engineer, Business Intelligence
As a Data Engineer on the Business Intelligence team, you will lead data collection and performance improvement efforts across multiple data sources and platforms to support analytics across the entire suite of Peloton products and services.
RESPONSIBILITIES
- Design, develop, deploy and manage a reliable and scalable data analysis pipeline, using technologies including Python and AWS
- Facilitate the transfer of data from internal sources to external tools and platforms
- Facilitate the transfer of data from external sources to our analytics database
- Identify gaps in our data collection and collaborate with product and engineering on data capture specifications
- Compile and reconcile data from multiple sources
- Develop a vision to extend/improve our existing analytics and reporting technology stack
- Stay up to date with the latest technologies and trends in analytics
REQUIREMENTS
- BS/MS in Computer Science or related field of study.
- 5+ years experience working in large scale data engineering environment (ETL, Hadoop, Hive, AWS, EC2, Redshift, etc.)
- Experience building and maintaining batch processes, using AWS Data Pipeline, Airflow, Luigi, cron, quartz, etc.
- Strong understanding of SQL and relational databases (experience in database administration is a plus+)
- Experience inspecting, moving, and transforming data on the *nix command line using shell scripts, Unix tools such as sed, awk, cut, sort, etc.; or higher level languages like Python/Perl/Ruby
- A solid foundation in computer science fundamentals with particular expertise in data structures, algorithms, and design
- Experience building systems that must deal with the complexities of integrating with third parties