Consumer Edge Logo

Consumer Edge

VP Data Engineering

Posted 2 Days Ago
Easy Apply
In-Office or Remote
Hiring Remotely in New York, NY, USA
270K-300K Annually
Expert/Leader
Easy Apply
In-Office or Remote
Hiring Remotely in New York, NY, USA
270K-300K Annually
Expert/Leader
The VP of Data Engineering will lead a team of data engineers, oversee GCP data platform architecture, and ensure high-quality data pipelines while collaborating with other departments.
The summary above was generated by AI

This role is remote (US-based; east coast preferred)

Company Overview

Join a dynamic team that's redefining consumer data analytics. We empower top investment firms and global consumer and corporate brands with cutting-edge insights into consumer spending, leveraging privacy-compliant data across geographies. Our real-time intelligence and merchant-level benchmarks give clients a competitive edge—and you'll be at the forefront of it all.

Role Summary

We're looking for a seasoned VP of Data Engineering to lead our data engineering team and take ownership of the infrastructure that powers everything we do. Because data is our business, this role carries significant weight: the reliability, scalability, and quality of our data pipelines directly impacts our customers and our revenue.

You'll manage ~15 engineers across 3 data engineering teams, set technical direction across our GCP-based data platform, and work closely with data operations, product, and commercial teams to ensure we can continuously ingest, process, and deliver alternative datasets at scale — with the rigour that financial services clients demand.

Your Main Responsibilities

Team Leadership

  • Lead, mentor, and grow a team of data engineers, building a culture of ownership, craft, and continuous improvement
  • Own hiring, onboarding, and performance management for the data engineering function
  • Act as a technical role model — setting high standards while remaining approachable and supportive

Data Platform & Infrastructure

  • Own the architecture, reliability, and evolution of our GCP data platform — including BigQuery, Cloud Composer/Airflow, Dataflow, Pub/Sub, and GCS
  • Design and maintain robust, scalable pipelines for ingesting, transforming, and serving diverse alternative datasets (web, CPG, transaction data, etc.)
  • Drive infrastructure best practices: cost optimisation, observability, incident response, and disaster recovery
  • Ensure data security, access controls, and compliance standards appropriate for regulated financial services clients

Strategic & Cross-functional

  • Translate business priorities and client requirements into a clear, deliverable technical roadmap
  • Partner with data operations, data science, and product teams to accelerate dataset onboarding and expand platform capabilities
  • Represent data engineering at the leadership level — contributing to company strategy and advocating for data quality as a core business value

We’re looking for someone with

Experience

  • 10+ years in data engineering, with at least 3 years in a leadership or management role (managing managers and teams)
  • Proven experience building and operating large-scale data pipelines on Google Cloud Platform
  • Experience in fintech, alternative data, financial data, or another data-as-a-product environment strongly preferred
  • Track record of delivering high-quality data infrastructure in a fast-moving, commercially sensitive context

Technical Skills

  • Deep expertise across the GCP data stack: BigQuery, Dataflow, Pub/Sub, GCS, Cloud Composer, and related services
  • Hands-on experience with dbt (Core or Cloud) for scalable transformation layer design, including modeling patterns, testing frameworks, and documentation standards
  • Strong understanding of data pipeline design, ELT/ETL patterns, data modelling, and workflow orchestration
  • Solid grasp of data governance, quality frameworks, and security best practices
  • Familiarity with the unique challenges of alternative data — diverse formats, inconsistent schemas, high ingestion volumes, and strict data provenance requirements
  • Practical experience with infrastructure-as-code tooling (Terraform and/or Pulumi) for provisioning and managing cloud resources; able to set IaC standards and review infrastructure changes with the same rigour applied to application code
  • Strong proficiency in Python and SQL; comfortable reviewing code and setting engineering standards across the team.

Leadership & Soft Skills

  • Excellent communicator with the ability to engage engineers, data scientists, and commercial stakeholders alike
  • Strong hiring instincts and a genuine passion for developing people
  • Pragmatic and decisive — able to balance technical rigour with commercial urgency
  • High ownership mindset; comfortable operating with autonomy in a high-stakes environment

 Nice to Have

  • Experience supporting data science or ML teams with feature engineering infrastructure
  • Familiarity with data licensing, provenance tracking, or data vendor management
  • Experience with data mesh or data-as-a-product organisational models
  • Open source contributions or published technical work

Why Join Consumer Edge

At Consumer Edge, the data engineering team isn't a support function - it's a core part of how we deliver value to clients. You'll be joining at a critical stage of growth, with the opportunity to shape the platform, the team, and the standards that the entire business depends on.

We offer a competitive salary, an extensive benefits package including 401(k) match, paid parental leave, flexible and generous time off, work-from-home flexibility, and a vibrant work environment conducive to professional growth and innovation. Join our team and play a significant role in driving data-driven decision-making, shaping the future of global consumer insights.

Compensation and Benefits

The annual base salary for this role is between $270,000– $300,000  based on experience, with the opportunity for a performance-based bonus, company equity, 401(k) matching, work-from-home flexibility, and subsidized health benefits.


Note Consumer Edge is currently hiring employees who reside in the following states or in Washington, DC:  CA, CO, CT, FL, ID, IL, LA, MA, MD, NC, NJ, NY, PA, RI, TN, TX, UT, VA, WA, WI 

#LI-Remote

#LI-DN

Top Skills

BigQuery
Cloud Composer
Dataflow
Dbt
Gcs
Google Cloud Platform
Pub/Sub
Pulumi
Python
SQL
Terraform
HQ

Consumer Edge New York, New York, USA Office

2 Grand Central Tower, 140 E 45th Street, 39th Floor, New York, NY, United States, 10017

Similar Jobs

7 Hours Ago
Remote or Hybrid
United States
112K-186K Annually
Senior level
112K-186K Annually
Senior level
Artificial Intelligence • Automotive • Greentech • Information Technology • Machine Learning • Software • Cybersecurity
The Senior Manager, Key Account Marketing leads remarketing strategy for high-value clients, managing comprehensive campaign development, analytics, and cross-functional collaboration to drive growth and client satisfaction.
Top Skills: Ai-Enabled ToolsCrm PlatformsMarketing Analytics ToolsSalesforce
19 Hours Ago
Easy Apply
Remote
United States
Easy Apply
170K-195K Annually
Senior level
170K-195K Annually
Senior level
Cloud • Information Technology • Security • Software
The Sr. Solutions Engineer will present customized solutions, conduct product demonstrations, lead client workshops, and support customer success through seamless transitions post-sale.
Top Skills: Grc Saas PlatformsNo-Code Platform
19 Hours Ago
Easy Apply
Remote or Hybrid
New York, NY, USA
Easy Apply
190K-250K Annually
Expert/Leader
190K-250K Annually
Expert/Leader
Fintech • HR Tech
Responsible for enhancing local development environments, troubleshooting issues, collaborating with teams, and leveraging AI for productivity. Requires extensive software development experience.
Top Skills: Ai TechnologiesKafkaRuby on RailsRubySidekiq

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account