Sportradar Logo

Sportradar

Senior Data Engineer

Posted 11 Hours Ago
In-Office
New York, NY, USA
Senior level
In-Office
New York, NY, USA
Senior level
Design, build, and maintain large-scale data pipelines and ETL processes (NiFi, Kafka, AWS) using Python and Java. Create data models, automated cleaning, monitoring, unit tests, and warehousing solutions. Collaborate with engineering teams, use Docker and JIRA, and support analytics and data science consumers.
The summary above was generated by AI
Company Description

We’re the world’s leading sports technology company, at the intersection between sports, media, and betting. More than 1,700 sports federations, media outlets, betting operators, and consumer platforms across 120 countries rely on our know-how and technology to boost their business.

Job Description

THE CHALLENGE

  • Design, build, and implement generalized large-scale, sophisticated data pipelines using Nifi for downstream analytics and data science for our Sport Performance products.
  • Design and develop scalable Nifi ingestion pipelines within AWS cloud services to consume real-time and batch data from external sources. Ensure the seamless integration of AWS-based tools for data storage, processing, and analytics.
  • Responsible for ETL development and warehousing using Python and Java. Create data pipeline triggers and filters within ETL (extract, transform, and load) process to ensure appropriate optimization of data flowing through system and resource usage. Implement monitoring and error handling for all new parts of the data pipeline to ensure observability and alerting is available.
  • Establish rigorous unit testing across the data pipeline to ensure robustness of the system.
  • Design and create data models for use throughout the ETL system.
  • Utilize Kafka to efficiently and to effectively store data to move throughout the data pipeline and for downstream data science and analytics usage.
  • Design data architecture and data models for both internal and external representations of data.
  • Build the data transforms within the data pipeline to convert data from external to internal representations.
  • Conduct data analytics and debugging of bad data by writing SQL queries.
  • Build automated cleaning of data to remove bad or unusable data from downstream consumers with logging to understand the frequency and depth of the underlying issues.
  • Collaborate with other engineering teams to adopt standard methodologies, drive scalability, and increase consistency across systems.
  • Maintain awareness of company standards and technology guidance; use JIRA, an Agile project mgmt. tool, to ensure efficient data development; collaborate with peers to align projects with overall direction.
  • Follow best practices across Data Engineering to ensure scalable, consistent data architecture and system. Utilize Java language to build data processor in Nifi framework.
  • Utilize Docker to ensure consistent, repeatable, and isolated environment for software development and testing.
  • Work in a self-driven, independent fashion to meet Sport driven deadlines. 

 

*Position permits telecommuting from anywhere in the U.S.

ABOUT YOU:

  • Master’s degree in Computer Science, Computer Engineering, or closely related field and 1 year experience as a data engineer or related occupation.

Must possess 1 year of experience with:

  • Python, Java, Kafka, AWS, and Docker
  • ETL Development and Warehousing
  • Analytic and debugging using SQL
  • Agile development environment
  • Designing data architecture

 

OUR OFFER
 

  • A collaborative environment with colleagues from all over the world (Offices in Europe, Asia and US) including various social events and teambuilding.
  • Flexibility to manage your workday and tasks with autonomy.
  • A balance of structure and autonomy to tackle your daily tasks.
  • Vibrant and inclusive community, including Women in Tech and Pride groups which welcome all participants.
  • Global Employee Assistance Programme.
  • Calm and Reulay app (leading well-being apps designed to support focus, quality rest, mindfulness, and long-term mental resilience).
  • Online training videos.
  • Flexible working hours.

Additional Information

Sportradar intends to offer the selected candidate base pay within this range, dependent on job-related, non-discriminatory factors including but not limited to experience, qualifications, and location. Base pay is just one component of the Total Rewards that Sportradar provides to compensate and recognize employees for their work. Sportradar offers best-in-class benefits such as a comprehensive benefits package, performance bonus program, equity stock purchase and 401k contribution. Please consult with your recruiter to learn more as all benefits are subject to eligibility requirements.

At Sportradar, we celebrate our diverse group of hardworking employees. Sportradar is committed to ensuring equal access to its programs, facilities, and employment opportunities. All qualified applicants will receive consideration for employment without regard to age, race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran. We encourage you to apply even if you only meet most of the requirements (but not 100% of the listed criteria) – we believe skills evolve over time. If you’re willing to learn and grow with us, we invite you to join our team!

Sportradar New York, New York, USA Office

521 5th Ave, 30th, New York, NY, United States, 10175

Similar Jobs

Yesterday
Remote or Hybrid
US
135K-155K Annually
Senior level
135K-155K Annually
Senior level
Professional Services • Software
Lead architecture and buildout of a new graph-backed enterprise data platform: design ingestion, graph and relational storage, entity resolution pipelines, temporal models, ETL/ELT pipelines, governance, APIs, and production connectors. Ship scalable graph data models, traversal queries, and platform roadmap while enabling observability, security, and containerized deployments.
Top Skills: AirflowAzureCypherDagsterDbtDockerGremlinHelmJavaKubernetesPythonSalesforceServicenowSparqlSQL
4 Days Ago
Easy Apply
Remote or Hybrid
United States
Easy Apply
186K-222K Annually
Senior level
186K-222K Annually
Senior level
eCommerce • Healthtech • Kids + Family • Retail • Social Media
Design and scale data pipelines and ML/LLM systems, build agentic automation for pipeline generation and maintenance, improve data monitoring, and collaborate with analysts, product, and ML teams to deliver reliable end-to-end data and AI infrastructure for a high-growth e-commerce platform.
Top Skills: AirflowAws Ec2Aws EksAws LambdaAws S3DbtLlmsMcp ServersMl PipelinesPythonRagSnowflake
7 Days Ago
Easy Apply
Remote or Hybrid
United States
Easy Apply
118K-179K Annually
Senior level
118K-179K Annually
Senior level
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Design, build, and operate large-scale data platforms and Spark/PySpark pipelines. Enable data integration, modeling, quality, and observability. Build MCP servers and AI-augmented tooling, mentor engineers, and lead cross-functional projects to deliver reliable data products.
Top Skills: Ai AgentsApache IcebergAuroraAWSAws RdsAzureDatabricksDbtFivetranGCPGoogle BigqueryMcp ServersMs Sql ServerMySQLOraclePostgresPysparkPythonSnowflakeSparkSQL

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account