Leads a data engineering team and oversees the design, development, reliability, security, and scalability of data pipelines, warehouses, platforms, and integrations. Translates business needs into technical solutions, establishes data quality and governance standards, reviews architecture and code, manages projects and resources, resolves infrastructure issues, mentors engineers, and communicates progress and risks to leadership.
The Data Engineering Manager leads the design, development, and maintenance of data infrastructure and pipelines that support analytics, reporting, machine learning, and business operations. This role combines technical leadership with people management, ensuring that data systems are reliable, scalable, secure, and aligned with business requirements.
Key Responsibilities
- Lead and manage a team of data engineers.
- Design and oversee scalable data pipelines, data warehouses, and data platforms.
- Establish standards for data quality, reliability, security, and governance.
- Collaborate with data scientists, analysts, software engineers, and business stakeholders.
- Translate business requirements into effective data engineering solutions.
- Monitor data infrastructure and resolve performance or reliability issues.
- Oversee data integrations from internal and external sources.
- Review technical designs and code to maintain engineering quality.
- Plan projects, prioritize workloads, and manage engineering resources.
- Mentor team members and support their professional development.
- Evaluate and introduce appropriate data technologies and tools.
- Ensure data systems comply with organizational security and privacy requirements.
- Monitor project timelines, budgets, and deliverables.
- Communicate technical progress, risks, and recommendations to senior leadership.
Qualifications
- Bachelor's degree in Computer Science, Data Engineering, Information Technology, or a related field.
- 5+ years of experience in data engineering or a related technical field.
- Previous experience leading or managing data engineering teams.
- Strong knowledge of SQL and programming languages such as Python or Java.
- Experience with data warehouses, databases, ETL/ELT processes, and data pipelines.
- Experience with cloud platforms such as AWS, Microsoft Azure, or Google Cloud.
- Strong understanding of data architecture and data modeling.
- Excellent leadership, communication, and problem-solving skills.
Preferred Skills
- Experience with platforms such as Snowflake, Databricks, BigQuery, or Redshift.
- Familiarity with Apache Spark, Kafka, Airflow, or similar data technologies.
- Experience implementing CI/CD and automated testing for data pipelines.
- Knowledge of data governance, security, and compliance practices.
- Experience working in Agile/Scrum environments.
- Strong project management and stakeholder-management skills.
Similar Jobs
Retail • Sports
Leads customer data engineering strategy, delivery, team development, and roadmapping. Oversees data-driven product improvements, digital programs, quality initiatives, budgets, cybersecurity remediation, and portfolio management. Manages, mentors, and grows data engineering teams, including contractor teams, while guiding customer data platforms, omnichannel identity resolution, complex data modeling, and personalization-focused data science capabilities. Partners across the organization to execute strategic initiatives and build team capability.
Top Skills:
DatabricksGoogle BigquerySnowflake
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead Atlassian’s TDP SQL engineering team, owning people leadership, platform strategy, roadmap execution, reliability, security, compliance, incident response, technical direction, cross-functional dependencies, infrastructure economics, and operational outcomes. Build a high-performing organization and evolve a scalable managed relational database platform across multiple cloud environments while supporting enterprise requirements such as data residency, encryption, disaster recovery, and tenant isolation.
Top Skills:
Backup And RecoveryCloud InfrastructureDisaster RecoveryDistributed Relational DatabasesEncryptionMulti-Cloud InfrastructureSQLTenant Isolation
Fintech • Financial Services
Lead and mentor data engineering and DBA teams while driving GCP-based streaming and batch data platform initiatives. Oversee BigQuery, dbt, Apache Flink or Dataflow, data quality, testing, observability, governance, reliability, and cloud cost optimization. Remain hands-on with coding, code reviews, architecture, and complex system problems while aligning data infrastructure with business and product goals. Champion AI-assisted engineering and automation across the platform.
Top Skills:
Apache FlinkBigQueryDataflowDbtGoogle Cloud PlatformMySQLPostgres
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
