Consumer Edge Logo

Consumer Edge

VP Data Engineering

Sorry, this job was removed at 08:08 p.m. (EST) on Tuesday, Jun 02, 2026
In-Office or Remote
Hiring Remotely in New York, NY, USA
In-Office or Remote
Hiring Remotely in New York, NY, USA

Similar Jobs

25 Minutes Ago
In-Office or Remote
New York, NY, USA
123K-223K Annually
Mid level
123K-223K Annually
Mid level
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Field-driven Territory Account Executive responsible for full-cycle, self-sourced sales: prospecting, in-person demos, closing deals, building pipeline and partnerships, managing Salesforce, and exceeding quota in South Brooklyn.
Top Skills: Salesforce
26 Minutes Ago
Easy Apply
Remote
United States
Easy Apply
204K-290K Annually
Senior level
204K-290K Annually
Senior level
Big Data • Fintech • Mobile • Payments • Financial Services
Lead a Reliability Platform Engineering team to build operational intelligence, observability, and AI-driven tooling that improves production availability, resiliency, and operational governance. Partner with Platform, SRE, Infrastructure, and Product teams to define reliability standards, prioritize investments, and deliver scalable reliability and automation solutions.
Top Skills: AIJavaKotlinObservabilityPython
35 Minutes Ago
Remote
United States
164K-193K Annually
Senior level
164K-193K Annually
Senior level
Healthtech • Social Impact • Software • Telehealth
Build and maintain scalable, secure data pipelines and platforms to enable AI-driven analytics. Partner with analytics, product, and marketing to translate requirements, deploy production systems, implement data governance and access controls, and support AI applications at scale.
Top Skills: AWSIcebergKafkaLarge Language Models (Llms)Model Context Protocols (Mcps)PythonSemantic LayersSnowflakeSparkSQLTerraform

This role is remote (US-based; east coast preferred)

Company Overview

Join a dynamic team that's redefining consumer data analytics. We empower top investment firms and global consumer and corporate brands with cutting-edge insights into consumer spending, leveraging privacy-compliant data across geographies. Our real-time intelligence and merchant-level benchmarks give clients a competitive edge—and you'll be at the forefront of it all.

Role Summary

We're looking for a seasoned VP of Data Engineering to lead our data engineering team and take ownership of the infrastructure that powers everything we do. Because data is our business, this role carries significant weight: the reliability, scalability, and quality of our data pipelines directly impacts our customers and our revenue.

You'll manage ~15 engineers across 3 data engineering teams, set technical direction across our GCP-based data platform, and work closely with data operations, product, and commercial teams to ensure we can continuously ingest, process, and deliver alternative datasets at scale — with the rigour that financial services clients demand.

Your Main Responsibilities

Team Leadership

  • Lead, mentor, and grow a team of data engineers, building a culture of ownership, craft, and continuous improvement
  • Own hiring, onboarding, and performance management for the data engineering function
  • Act as a technical role model — setting high standards while remaining approachable and supportive

Data Platform & Infrastructure

  • Own the architecture, reliability, and evolution of our GCP data platform — including BigQuery, Cloud Composer/Airflow, Dataflow, Pub/Sub, and GCS
  • Design and maintain robust, scalable pipelines for ingesting, transforming, and serving diverse alternative datasets (web, CPG, transaction data, etc.)
  • Drive infrastructure best practices: cost optimisation, observability, incident response, and disaster recovery
  • Ensure data security, access controls, and compliance standards appropriate for regulated financial services clients

Strategic & Cross-functional

  • Translate business priorities and client requirements into a clear, deliverable technical roadmap
  • Partner with data operations, data science, and product teams to accelerate dataset onboarding and expand platform capabilities
  • Represent data engineering at the leadership level — contributing to company strategy and advocating for data quality as a core business value

We’re looking for someone with

Experience

  • 10+ years in data engineering, with at least 3 years in a leadership or management role (managing managers and teams)
  • Proven experience building and operating large-scale data pipelines on Google Cloud Platform
  • Experience in fintech, alternative data, financial data, or another data-as-a-product environment strongly preferred
  • Track record of delivering high-quality data infrastructure in a fast-moving, commercially sensitive context

Technical Skills

  • Deep expertise across the GCP data stack: BigQuery, Dataflow, Pub/Sub, GCS, Cloud Composer, and related services
  • Hands-on experience with dbt (Core or Cloud) for scalable transformation layer design, including modeling patterns, testing frameworks, and documentation standards
  • Strong understanding of data pipeline design, ELT/ETL patterns, data modelling, and workflow orchestration
  • Solid grasp of data governance, quality frameworks, and security best practices
  • Familiarity with the unique challenges of alternative data — diverse formats, inconsistent schemas, high ingestion volumes, and strict data provenance requirements
  • Practical experience with infrastructure-as-code tooling (Terraform and/or Pulumi) for provisioning and managing cloud resources; able to set IaC standards and review infrastructure changes with the same rigour applied to application code
  • Strong proficiency in Python and SQL; comfortable reviewing code and setting engineering standards across the team.

Leadership & Soft Skills

  • Excellent communicator with the ability to engage engineers, data scientists, and commercial stakeholders alike
  • Strong hiring instincts and a genuine passion for developing people
  • Pragmatic and decisive — able to balance technical rigour with commercial urgency
  • High ownership mindset; comfortable operating with autonomy in a high-stakes environment

 Nice to Have

  • Experience supporting data science or ML teams with feature engineering infrastructure
  • Familiarity with data licensing, provenance tracking, or data vendor management
  • Experience with data mesh or data-as-a-product organisational models
  • Open source contributions or published technical work

Why Join Consumer Edge

At Consumer Edge, the data engineering team isn't a support function - it's a core part of how we deliver value to clients. You'll be joining at a critical stage of growth, with the opportunity to shape the platform, the team, and the standards that the entire business depends on.

We offer a competitive salary, an extensive benefits package including 401(k) match, paid parental leave, flexible and generous time off, work-from-home flexibility, and a vibrant work environment conducive to professional growth and innovation. Join our team and play a significant role in driving data-driven decision-making, shaping the future of global consumer insights.

Compensation and Benefits

The annual base salary for this role is between $270,000– $300,000  based on experience, with the opportunity for a performance-based bonus, company equity, 401(k) matching, work-from-home flexibility, and subsidized health benefits.


Note Consumer Edge is currently hiring employees who reside in the following states or in Washington, DC:  CA, CO, CT, FL, ID, IL, LA, MA, MD, NC, NJ, NY, PA, RI, TN, TX, UT, VA, WA, WI 

#LI-Remote

#LI-DN

HQ

Consumer Edge New York, New York, USA Office

2 Grand Central Tower, 140 E 45th Street, 39th Floor, New York, NY, United States, 10017

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account