Top Senior Data Engineer Jobs in NYC, NY

Lead data engineering efforts, manage data governance, ensure compliance, and oversee data platform economics while designing scalable systems.

The role involves architecting and improving data systems, defining governance standards, optimizing performance, and mentoring engineers in data engineering.

Build scalable data solutions and reconciliations to automate Compliance & Finance regulatory processes. Partner with stakeholders to translate requirements into designs, lead technical development, review code, and evolve standards for data pipelines and reporting.

Lead design and development of web UI and REST middleware within an Agile team. Define requirements and acceptance criteria, implement Java/Spring and Angular solutions, build CI/CD pipelines, work with Product Owner and testers, and produce/update design documentation.

Design, build, and optimize scalable ETL/ELT data pipelines using Databricks and cloud platforms. Implement data quality checks, monitor and troubleshoot jobs, audit pipelines for compliance, and collaborate with analysts and business stakeholders to define data models and support reporting.

Senior Exasol data engineer to design, build, optimize, and validate SQL-based data pipelines for healthcare analytics. Responsibilities include complex query tuning, extracting/staging from SQL Server, chart validation, applying clinical terminologies, quality measure development, and maintaining disciplined version-controlled engineering practices.

Lead design, build, and support of scalable data pipelines and integrations using Microsoft Fabric, ADF, PySpark, SQL, ADLS Gen2, and Databricks Unity Catalog. Drive Azure-to-Fabric migration, stabilize pipelines, tune performance, manage data governance, troubleshoot issues, document designs, mentor team members, and collaborate with stakeholders in Life Sciences regulatory environments during US Eastern hours.

This role involves developing data pipelines, ensuring data performance, automating processes, and collaborating within Agile teams to meet complex data requirements.

As a Sr Data Engineer, you'll conduct feasibility analyses, develop applications, monitor processes, consult with users, and ensure compliance while serving as a mentor to junior analysts.

Manage delivery of complex data pipelines in a hands-on role, leading a team of data engineers to develop scalable data solutions and improve analytics capabilities.

The Principal Data Engineer will lead complex data projects, design robust data pipelines, and drive architectural strategy for a scalable data ecosystem, while mentoring other engineers and ensuring the quality and usability of data solutions.

As an Analytics Engineer, you will create scalable solutions for data reporting, build data pipelines, and establish high data integrity standards while collaborating with multiple teams.

Design, build, maintain, and optimize Spark and Scala ETL/ELT pipelines on AWS for terabyte- and petabyte-scale datasets. Work across S3, Snowflake, Kafka, and monitoring systems, resolve production data-quality and performance issues, write automated tests, participate in architecture and code reviews, and support on-call operations. Use generative AI to improve pipeline development, monitoring, and engineering productivity.

Designs and maintains healthcare data pipelines, ETL workflows, databases, schemas, and analytical frameworks. Analyzes claims and related healthcare data to identify trends and insights, while ensuring data quality and integrity. Creates reports, dashboards, and visualizations for nontechnical stakeholders. Collaborates with healthcare policy experts, analysts, and stakeholders to translate requirements into data solutions and improve infrastructure, processes, and analytics capabilities.

Designs, develops, optimizes, and maintains enterprise data platforms, databases, ETL workflows, reporting solutions, and business intelligence systems. Leads technical design, SDLC processes, production troubleshooting, documentation, stakeholder collaboration, and automation efforts. Requires advanced Microsoft SQL Server, T-SQL, and SSIS expertise, plus experience with data warehousing, BI, dashboards, and Microsoft DevOps. Cloud data services, APIs, Microsoft BI tools, and Python or Java are preferred or advantageous.

Designs, develops, and optimizes enterprise data platforms, databases, ETL workflows, data integrations, reporting, and business intelligence solutions. Leads technical designs, automated process improvements, production troubleshooting, documentation, and dashboard development. Collaborates with stakeholders and vendors, supports scalability and cloud migration, and participates in an off-hours support rotation. Requires advanced SQL Server, SSIS, T-SQL, SDLC, and data engineering expertise.

The Data Engineer will design and maintain data pipelines on Azure, manage ClickHouse for analytics, and ensure healthcare compliance while supporting ML integration.

Build and maintain scalable batch and real-time data pipelines, model data to power analytics and ML, and operate distributed data systems. Collaborate with business, engineering, and data science teams to ensure data quality, documentation, and debugging while adopting new technologies and working in an ambiguous, fast-changing environment.

Build and maintain low-latency, highly available distributed data systems and services to deliver high-quality data for product, analytics, and ML. Partner with data scientists and product teams to design scalable, observable, multi-tenant data products using batch and real-time processing frameworks. Ensure 24x7 reliability, monitoring, and operational excellence while owning end-to-end delivery.

Design, build, and own large-scale batch and streaming data pipelines and core Ads data products. Collaborate with analytics, data science, and engineering teams to model, transform, govern, and deliver high-quality ad datasets for analysis, ML, and reporting while ensuring privacy compliance.

Lead design, development, and optimization of Snowflake-based data platforms and scalable ELT/ETL pipelines. Build dimensional models, data marts, and curated analytical datasets; implement Snowpark, stored procedures, streams, tasks; enforce data quality, lineage, governance, and security; automate orchestration with Airflow/Azure Data Factory/AWS Glue; support finance, risk, compliance, and regulatory reporting; mentor junior engineers.

Build and maintain centralized pricing data infrastructure, scalable workflows, and data pipelines; integrate AI capabilities; deliver pricing tools, reporting, and governance to support data-driven pricing and budgeting across the firm.

Own SQL and dbt-based data modeling and data quality for clinical and claims datasets. Author and refactor dbt models/tests, triage DQ alerts, design monitors, optimize SQL performance, and collaborate with Data Engineering and stakeholders to ensure trusted production datasets.

Own and evolve the data lake and analytics stack powering fleet observability. Build and maintain scalable ETL/ELT pipelines, operate data lake infrastructure (Iceberg, Trino, Airflow, Spark, Superset), produce analytics and executive reporting, create dashboards and runbooks, and implement data governance and observability.

Design, build, and maintain scalable data ingestion and ETL pipelines across a growing data lake. Define and enforce data quality standards, SLOs, and validation frameworks. Optimize pipelines for performance and cost, expand monitoring and alerting, and enable stakeholders to self-serve on data infrastructure.