Mastercard Logo

Mastercard

Lead Data Engineer

Reposted 2 Days Ago
Be an Early Applicant
Hybrid
Dublin
Senior level
Hybrid
Dublin
Senior level
The Lead Data Engineer will provide technical leadership, design complex data workflows, build data models, and maintain data quality while mentoring junior engineers and collaborating with cross-functional teams.
The summary above was generated by AI
Our Purpose
Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.
Title and Summary
Lead Data Engineer
Overview
Mastercard is the global technology company behind the world's fastest payments processing network. We are a vehicle for commerce, a connection to financial systems for the previously excluded, a technology innovation lab, and the home of Priceless®. We ensure every employee has the opportunity to be a part of something bigger and to change lives. We believe as our company grows, so should you. We believe in connecting everyone to endless, priceless possibilities.
Our team within Mastercard:
Mastercard Foundry R&D is looking for a talented Lead Data Engineer to join the Mastercard Foundry Research and Development team. In this role you will be part of a highly agile team building exciting and innovative products delivered at scale to global markets.
Our team is built on a foundation of research and development, mining innovation internally, innovating new product lines with emerging technology, managing new products from inception to market validation and engaging strategically with start-ups to shape the future of commerce with and for our customers. At Mastercard you will help define the future of commerce globally.
This team will have a diverse focus both in terms of geography and variety of technology challenges driving hard to bring innovative payment solutions and services to market.
As a Lead Data Engineer, you will:
- Provide technical leadership in data architecture, ensuring best practices for data modeling, storage, and retrieval.
- Lead the scoping, design and implementation of complex features including multi-layered data workflows.
- Lead and push the boundaries of analytics and powerful, scalable data workflows and applications.
- Build and maintain data models and data pipelines to enable performant and scalable products.
- Work with multiple sources of data, storage systems, and building processes and pipelines to provide cohesive datasets for analysis and modeling.
- Ensure a high-quality code base by writing and reviewing performant & scalable, well-tested code.
- Collaborate with cross-functional teams to define data requirements and design solutions that align with business objectives.
- Oversee data governance and quality, ensuring data accuracy, consistency, and compliance with industry standards.
- Mentor software engineers & data engineers, establishing data best practices and creating up-skilling opportunities for the team.
- Drive innovative improvements to team development processes.
- Partner with Product Managers and Customer Experience Designers to develop a deep understanding of users and use cases and apply that knowledge to scoping and building features.
- Collaborate across teams with exceptional peers who are passionate about what they do.
All about you:
- Extensive data engineering experience in an agile production environment.
- Experience in building and deploying production-level data-driven applications and data processing workflows/pipelines and/or implementing machine learning systems at scale.
- Experience leading the design and implementation of complex features.
- Experience leading a large project and working with other data and software engineers.
- Experience working in enterprise databases and ensure follow industry best practices around data privacy.
- Expertise in using Python or Scala, Spark, Hadoop platforms & tools (Hive, Impala, Airflow, NiFi, Scoop), SQL to build Big Data products & platforms.
- Experience in Java/.Net, Scala, or Python technologies and deliver analytics involving all phases like data ingestion, feature engineering, modeling, tuning, evaluating, monitoring, and presenting.
- Knowledge of AI/ML, data analytics, and data product development with emphasis on data quality, data privacy, and localization.
- Experience in anonymizing data, data product development, analytical models, and AI governance.
- Experience working with modern data engineering and analytics platforms, including hands-on expertise in implementing scalable architectures and optimizing data workflows.
- Experience with cloud platforms for data engineering and machine learning workflows.
- Effective communication and collaboration skills to work with both technical and non-technical stakeholders.
- Flexible to work with global offices across several time zones.
- Outstanding problem-solving skills and the ability to navigate complex data challenges.
The following is a plus:
- Experience with AWS cloud services for data engineering and ML workflows.
- Hands-on experience with Databricks, including Medallion Architecture and Delta Lake.
- Familiarity with industry best practices for collection and use of data.
- Strong technologist eager to learn new technologies and frameworks.
- Project management skills and a demonstrated ability to understand complex information product constructs.
- Knowledge of Splunk or other alerting and monitoring solutions.
- Experience with agile methodologies, DevOps practices, and CI/CD.
- Be able to engage and drive conversations with customers as needed.
Corporate Security Responsibility
All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:
  • Abide by Mastercard's security policies and practices;
  • Ensure the confidentiality and integrity of the information being accessed;
  • Report any suspected information security violation or breach, and
  • Complete all periodic mandatory security trainings in accordance with Mastercard's guidelines.

Top Skills

Airflow
AWS
Databricks
Hadoop
Hive
Impala
Nifi
Python
Scala
Scoop
Spark
SQL

Mastercard New York, New York, USA Office

Mastercard’s NYC Tech Hub unites experts from diverse backgrounds and disciplines, from software development to finance, data architecture to cybersecurity and beyond, to build systems that never fail for a world that never stops.

Similar Jobs at Mastercard

21 Hours Ago
Hybrid
D, Dublin, IRL
Senior level
Senior level
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Lead software engineering for Cross-Border payments platform, providing technical leadership, designing solutions, and mentoring junior engineers in a collaborative environment.
Top Skills: AWSCloud-Native EnvironmentsDevOpsJavaPcfRestful ServicesSpring Boot
Yesterday
Hybrid
Dublin, IRL
Senior level
Senior level
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
As a Senior Platform Architect, you'll design and deliver internet infrastructure solutions, generate technical documents, and manage projects to ensure alignment with Mastercard's standards.
Top Skills: Application ServersInternet SecurityInternet TechnologiesMicrosoft VisioWeb Servers
Yesterday
Hybrid
Dublin, IRL
Mid level
Mid level
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Design and deliver internet infrastructure solutions while ensuring alignment with MasterCard's standards. Collaborate with teams to generate system requirements and maintain documentation.
Top Skills: Cloud TechnologiesDatabase TechnologiesLoad BalancersMicrosoft VisioWeb Application FirewallsYamlZero Trust Architecture Principles

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account