JW Player serves over 1.5 billion unique users a month and ingests over 1.5 terabytes a day. A lot of users means a lot of data, and it's up to our Data Pipelines team to help make sense of it all.

As a Senior Software Engineer on the Data Pipelines team, you will provide the entire company with high-quality data using cutting-edge big data tools in our fast-paced, learning-centered environment. You will be encouraged to develop your passions and investigate technologies you’re interested in while enjoying a highly democratic team where not only is your opinion valued, it’s necessary for our continued success!

In this role you will:

• Cultivate a deep understanding of Spark's inner workings. Use that knowledge to build high-performance, fully-optimized Spark jobs
• Build robust, bullet-proof pipelines using Luigi and Airflow
• Leverage Flink and Kafka to process real-time data at lightning speed
• Go deep on Postgres. Optimize our schemas, indexes, partitions, and bulk loading strategies
• Make our data warehouse more efficient and evaluate new data stores
• Develop new uses for our data, such as bulk exports and automatic content registration
• Follow industry-standard best practices to ensure data quality and integrity
• Improve our test data generators and enhance our QA infrastructure
• Be part of a highly-skilled team that values kindness, open communication, and mentorship

Cool technologies you'll get to work with :

• Languages : Python, Java, Javascript
• Big Data : Spark, Flink, Kafka
• Workflow : Luigi, Airflow
• Data Stores : Postgres, ElasticSearch, Redis
• Cloud : AWS, EMR, EC2, S3
• Data Lake : Snowflake, Athena
• Tools : Falcon, Flask, Docker, Github

What we're looking for :

• 3+ years of relevant experience writing code for a production environment
• Strong work ethic and drive to learn new skills
• Solid testing skills (i.e., unit tests, integration tests, smoke tests, and performance tests)
• Exceptional communication skills
• A collaborative spirit and desire to work with other humans
• Curiosity about data, especially big data

Some other things that will help you :

• A degree in Computer Science or equivalent experience
• Experience with Python
• Experience with data engineering and analytics
• An interest in data science
• Javascript skills, or an interest in developing them

About JW Player

JW Player pioneered video on the web over a decade ago and continues to innovate as the world’s largest network-independent platform for video delivery and intelligence. Media companies including Fox, VICE, Business Insider, and Univision, in addition to hundreds of thousands of creators of all types and sizes, rely on JW Player to deliver and monetize their content across all devices. JW Player’s massive global footprint of over 2 billion unique devices creates a powerful data graph of unique consumer insights and generates billions of incremental video views. The company is headquartered in New York, with offices in London and Eindhoven, and was named to Deloitte’s Technology Fast 500™ in 2017. For more information, visit http://www.jwplayer.com.

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.