Top Senior Data Engineer Jobs in NYC, NY

The Staff Data Engineer will lead design and implementation of analytics platforms and data products, collaborate cross-functionally, mentor engineers, and drive best practices at Upside.

Lead and mentor a data engineering team to design, develop, test, and support cloud-based big data and streaming solutions. Build full-stack data pipelines using Java/Scala/Python, RDBMS/NoSQL, Redshift/Snowflake, and cloud platforms. Collaborate with product managers, perform unit tests and code reviews, and promote engineering best practices and tech community engagement.

Design, build, and deliver scalable data pipelines and products end-to-end. Partner with analytics, product, and engineering to ingest diverse data sources, implement dbt transformations, ensure data quality, CI/CD, observability, monitoring, and cost/performance optimization. Leverage AI/automation for self-service tooling and intelligent pipelines while driving stakeholder alignment and reliable production operations.

As the founding engineer of the Data Intelligence team, you will design semantic layers, develop AI tooling, and automate data processes to drive business insights.

Lead design and scaling of the data platform and analytics pipelines. Build and maintain ETL/ELT workflows, integrations, serverless data services, and reliable data models. Mentor teammates, improve automation, observability, and data governance to support analytics and operational insights.

Designs and maintains scalable ETL pipelines using Ab Initio for the Oracle Ledger program. Implements data quality controls, governance, metadata management, lineage, remediation, and regulatory reporting. Develops SQL, data models, and Unix/Linux automation scripts while translating business requirements into technical solutions. Partners with governance, risk, architecture, and technology teams, supports audits and control evaluations, manages complex data projects, and coaches junior analysts.

The Senior Lead Data Engineer designs and develops technical solutions, leads a team of developers, and utilizes big data and cloud technologies to deliver robust solutions for Capital One.

Own and evolve the data infrastructure powering identity and fraud products. Build and operate scalable ETL/ELT pipelines, ensure data quality and observability, optimize storage and access, support product squads, respond to production incidents, mentor engineers, and drive data platform innovation.

Lead the Data Platform Engineering team owning ETL/reverse-ETL pipelines, replication, and production datastores. Define architecture, roadmap, standards (IaC, observability, schema contracts), mentor engineers, drive incident response and durable fixes, and partner on cross-team technical decisions and operational reliability for data correctness, completeness, and timeliness.

The Senior Data Engineer will design and implement scalable data models in BigQuery using dbt for analytics and reporting, ensuring data governance and optimal performance.

Lead design and operation of large-scale data pipelines and data APIs. Build Spark/PySpark workflows on Databricks, optimize job performance, manage data quality and observability, and develop MCP servers and AI-agent integrations. Mentor engineers, define standards, support production incidents and on-call rotations, and collaborate with stakeholders to deliver scalable data platform products.

Design, build, and operate scalable cloud data pipelines and platforms (Azure preferred). Implement DevSecOps, CI/CD, automated testing, monitoring, performance tuning, and production readiness. Mentor engineers, drive operational excellence, and translate requirements into robust technical designs. Apply healthcare domain knowledge and collaborate in agile teams to deliver secure, reliable data products.

Architect, build, and operate low-latency market data systems, including feed handlers, normalization, distribution, and exchange connectivity. Design high-throughput infrastructure for real-time trading data, improve reliability and performance, participate in observability, on-call, and incident response, and deliver well-tested features end to end. Partner with engineering, product, and cross-functional stakeholders while leading a lean, high-impact team.

Build and maintain governed Silver/Gold data models and semantic assets on Databricks. Translate stakeholder KPIs into testable, reusable transformations, apply enterprise modeling standards, enable domain self-service, ensure data sensitivity and governance, and review domain-contributed models for production readiness.

Design, build, and operate large-scale data platforms and Spark/PySpark pipelines. Enable data integration, modeling, quality, and observability. Build MCP servers and AI-augmented tooling, mentor engineers, and lead cross-functional projects to deliver reliable data products.

Design, build, and maintain scalable Spark-based ETL pipelines and computed tables in a central data lake. Integrate structured and unstructured IoT, sensor, and external data for analytics, model training, and dashboards. Collaborate with Data Science, Analytics, and ML teams to ensure reliable, high-quality customer-facing datasets.

Lead architecture and buildout of a new graph-backed enterprise data platform: design ingestion, graph and relational storage, entity resolution pipelines, temporal models, ETL/ELT pipelines, governance, APIs, and production connectors. Ship scalable graph data models, traversal queries, and platform roadmap while enabling observability, security, and containerized deployments.

Own and architect large-scale data pipelines, orchestration, and integrations. Drive IaC strategy (Terraform), third-party API and AI/LLM tool integrations, build export pipelines and internal tooling, mentor engineers, and align cross-team technical strategy for reliable, scalable data infrastructure.

Senior Addepar data engineer/analyst responsible for supporting and scaling Addepar integrations, building and maintaining data pipelines (Addepar↔Snowflake/Canoe/other platforms), diagnosing and resolving data quality issues, developing SQL-based reconciliations and automation, partnering with business and technology stakeholders, and supporting production operations, governance, testing, and documentation for wealth and asset management data.

Build and maintain production-grade data pipelines and ELT processes using Python, SQL, Airflow, and dbt within AWS. Design optimized schemas in PostgreSQL and Redshift, leverage AI/LLMs to improve development, automation, testing, and data quality, and scale infrastructure for large healthcare datasets.

Design, build, and maintain Keboola-based data pipelines integrating multiple business systems to deliver accurate, scalable data for supply chain, logistics, and transportation analytics; collaborate with analysts and engineers; support documentation, governance, and pipeline automation.

As a Data Engineer, you will develop solutions for customer-centric technology, ensuring platform integration and managing data architecture. Responsibilities include building data processes, maintaining data integrity, and collaborating cross-functionally to meet business challenges.

Lead data engineer responsible for designing and building scalable databases, ETL pipelines, and data messaging platforms. Develop and optimize SQL/stored procedures, implement Spark/Snowflake/Databricks solutions, automate processes with Python and shell scripts, and collaborate with global business stakeholders using Agile practices to deliver accurate, accessible data for operational stores, archives, and analytics.

Build and maintain production-grade data processing systems and foundational infrastructure for enterprise AI. Collaborate with researchers and engineers, deliver end-to-end implementations, transform unstructured data into performant datasets, and use distributed processing frameworks and modern analytics tooling to inform products and strategy.

Lead architecture and reliability of the data platform, build and harden ingestion (batch and CDC), own BigQuery+dbt transformations, establish testing/observability/governance, mentor engineers, develop Python tooling and APIs, run POCs for lakehouse/open table formats, and define AI-assisted development practices.