Wizard AI Logo

Wizard AI

Senior Director, Data

Reposted 19 Days Ago
Easy Apply
Remote
Hiring Remotely in USA
260K-285K Annually
Senior level
Easy Apply
Remote
Hiring Remotely in USA
260K-285K Annually
Senior level
Lead the company's data strategy, overseeing data architecture, acquisition, analytics, and operations to ensure data reliability and alignment with growth goals.
The summary above was generated by AI
About Wizard

Wizard is the top-performing AI Shopping Agent, delivering the best products from across the web with unmatched accuracy, quality, and trust. 

The Role

We’re hiring a Senior Director, Data Platform & Engineering to own the design, evolution and reliability of Wizard’s data platform. Data is foundational to everything we do from ingestion and compilation to personalization and ranking. This is a senior technical leadership role reporting directly to the CTO. This is not purely a strategic role and requires meaningful technical depth. You will be hands-on in architecture and code, setting standards through engineering judgement, not just oversight. 

What You’ll Do
  • Own Wizard’s end-to-end Spark-based data platform, including ingestion, transformation, compilation, quality enforcement, reliability standards, and long-term architectural evolution, ensuring our infrastructure scales to power AI-driven personalization and ranking systems
  • Serve as the architectural authority for distributed data systems, setting and enforcing non-negotiable standards for correctness, performance, cost efficiency, and production grade engineering discipline
  • Architect, review, and occasionally contribute to production PySpark pipelines (~20% hands-on), bringing recent, real engineering experience from the last 3–5 years.
  • Develop proof of concepts and experimental data architectures when exploring new approaches, demonstrating feasibility through hands on builds before operationalizing and handing off to the team
  • Incorporate AI assisted coding and modern AI tooling into the development workflow, both personally and across the team to accelerate experimentation, improve engineering velocity and continuously evolve platform capabilities
  • Balance near term delivery pressure with long term platform health ensuring speed does not compromise data integrity and model performance
  • Oversee data ingestion, normalization, and enrichment of crawled, API and other feed-based datasets to power our AI Search
  • Reinvent data operations using the latest AI tooling
What Success Looks Like
  • Data pipelines are highly scalable and cost efficient
  • Data platform reliability and quality standards are clearly defined and consistently enforced
  • Engineering teams rely on your judgement 
  • Data infrastructure supports AI projects at scale
Ideal Background
  • Hands on technical role with Pyspark experience within the last 3 years
  • 12+ years of experience in data engineering 
  • Proven experience operating production data platforms at scale in AWS and GCP
  • Comfortable contributing technically while leading at a senior level
  • Experience with AI/ML workloads 
  • Experience building data quality and observability frameworks
Compensation & Benefits

The expected base salary range for this role is $260,000 – $285,000 USD, and will vary based on skills, experience, role level, and geographic location. Final compensation will be determined by considering these factors alongside overall role scope and responsibilities.

In addition to base salary, Wizard offers:

  • Equity in the form of stock options
  • Medical, dental, and vision coverage
  • 401(k) plan
  • Flexible PTO and company holidays
  • Fully remote work within the United States
  • Periodic company-wide offsites and team gatherings

Wizard is committed to fair, transparent, and competitive compensation practices.

Top Skills

Airflow
Spark
AWS
Azure
Data Acquisition
Data Analytics
Data Engineering
Data Operations
GCP
HQ

Wizard AI New York, New York, USA Office

New York, New York, United States, 10013

Similar Jobs

Yesterday
In-Office or Remote
Minnetonka, MN, USA
159K-273K Annually
Senior level
159K-273K Annually
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Executive leader responsible for AI/ML strategy and delivery to transform healthcare claims and related operations. Leads global teams to develop production-grade ML, GenAI, LLM and MLOps solutions, ensure model governance, partner across business and technology, and drive measurable operational and clinical outcomes while ensuring compliance and data governance.
Top Skills: Agent To Agent Protocol (A2A)Agentic AiSparkAWSAzureETLGCPGenaiHadoopKerasLlmsMlopsModel Context Protocol (Mcp)PythonPyTorchQuantum AnnealingRScikit-LearnSnowflakeSQLTensorFlowXgboost
2 Days Ago
Easy Apply
Remote
US
Easy Apply
184K-314K Annually
Senior level
184K-314K Annually
Senior level
Cloud • Security • Software • Cybersecurity • Automation
Lead a unified analytics organization for Marketing and Product, define shared metrics and measurement frameworks, deliver executive-ready insights, build forecasting and experimentation programs, partner with engineering and privacy teams, and hire and mentor multi-layer analytics teams to drive product adoption and business outcomes.
Top Skills: SQLTableau
Yesterday
Remote
United States of America
200K-240K Annually
Senior level
200K-240K Annually
Senior level
Information Technology • Software • Consulting
Lead and grow a global data engineering and ML organization, design cloud-native data platforms and pipelines, deliver ML-powered products, establish engineering and MLOps best practices, and support sales through solutioning and client-facing technical leadership.
Top Skills: Aws,Azure,Gcp,Databricks,Snowflake,Redshift,Bigquery,Spark,Kafka,Airflow,Dbt,Kubernetes,Sagemaker,Azure Ml,Tensorflow

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account