Top Senior Data Engineer Jobs in NYC, NY

Data Engineer II will modernize BlueLabs’ data platform by leading Kimball dimensional modeling and legacy warehouse migrations, building reliable production data pipelines, and enforcing data quality standards. The role requires advanced SQL, Python, and dbt expertise, hands-on Snowflake and Redshift experience, and ownership of testing, documentation, observability, and scalable architecture. The engineer will collaborate cross-functionally, guide Data Engineer I team members, contribute to architectural decisions, and translate business logic into maintainable, cloud-agnostic data layers.

Designs, builds, and optimizes scalable data pipelines, ETL workflows, integrations, and reporting solutions. Develops SQL, Python, and Spark data-processing solutions using Azure Data Factory and Microsoft Fabric, while monitoring production reliability and performance. Collaborates with stakeholders, participates in code reviews, documents technical solutions, mentors junior engineers, and improves engineering practices. Requires strong data modeling, cloud data platform, Git, communication, and problem-solving skills.

Leads the design, development, and operation of production-grade data pipelines and governed data products supporting operational resiliency and recovery-risk analytics. Responsibilities include data modeling, ETL, database optimization, data quality and lineage, cloud and event-driven architectures, automation, testing, and CI/CD. Partners with cybersecurity, technology controls, engineers, architects, analysts, and business stakeholders to translate risk and control requirements into scalable, auditable solutions.

Build and manage dbt data pipelines, canonical datasets, dashboards, reporting, and foundational data products. Partner with Product, Engineering, and cross-functional teams to define reliable metrics, data models, technical requirements, and analytics systems for consumer products. Establish data integrity standards and SLAs, enable self-service analytics, and influence Product roadmaps through data architecture expertise.

Designs, builds, and maintains secure data pipelines, ETL processes, data warehouses, and quality controls. Collects, validates, cleanses, and analyzes data; develops SQL queries, Tableau dashboards, and AWS-based solutions; investigates data integrity issues; documents standards; and partners with stakeholders to deliver technical solutions using Agile and DevOps practices.

Designs trusted Snowflake data products and enterprise semantic models that standardize business concepts, metrics, relationships, and rules. Builds Cortex semantic views and agents, validates AI-generated results, develops regression tests, and maintains metadata, lineage, and documentation. Leads modeling initiatives from discovery through production while partnering with business and technical stakeholders to improve analytics, automation, and AI consistency.

Leads enterprise data engineering strategy and architecture for pipelines, external data sharing, and scalable data platforms. Designs and codes critical data solutions while driving adoption of modern technologies, governance, resiliency, operational excellence, and unified data architecture. Advises stakeholders, mentors engineers, recruits talent, evaluates emerging data and AI technologies, and develops platform roadmaps. The role requires hands-on expertise across AWS, lakehouse architecture, streaming, distributed computing, data warehousing, and multiple programming languages.

Build and deliver Azure and Microsoft Fabric data solutions for clients. Responsibilities include developing data pipelines with Azure Databricks, Data Factory, Synapse Analytics, and Fabric; writing SQL, Python, and PySpark; supporting data integration, testing, deployments, troubleshooting, CI/CD, and infrastructure management. The role involves consulting with client stakeholders, collaborating with architects and developers, and delivering modern data platforms and reporting solutions.

Design and maintain Snowflake-based data platforms, cloud-native data lakes, and scalable ETL/ELT pipelines for asset-backed finance analytics. Orchestrate workflows with Dagster and AWS services, ensure data reconciliation and integrity, and support migration from legacy systems. Contribute to project planning, Jira backlog management, testing, cutover planning, and cross-functional go-live readiness.

Design and maintain Snowflake data pipelines and data lake architectures for asset-based finance analytics. Develop ETL/ELT workflows, validate and reconcile financial data, migrate legacy systems, and translate quantitative finance logic into scalable architectures. Support project execution through requirements breakdown, planning, testing, cutover, and go-live readiness. Collaborate across engineering, quantitative analytics, and stakeholder teams.

Build and optimize batch and streaming data pipelines for AI, analytics, and enterprise platforms. Develop scalable transformations across cloud and lakehouse environments, implement data modeling, lineage, metadata, quality controls, and orchestration, and resolve complex performance and reliability issues. Partner with cross-functional teams to deliver secure, governed data solutions while mentoring engineers and leading modern data engineering initiatives.

Build and maintain external market data ETL pipelines and warehouses using Snowflake, Databricks, Sybase, Azure, dbt, and Python. Troubleshoot data access and performance issues, optimize data consumption for cost and reliability, design Azure data delivery channels, and coordinate deployments with infrastructure teams. The role also contributes to backend database development, data architecture, operational excellence, testing, and performance optimization within financial services.

Design, build, and maintain scalable batch and streaming data pipelines using Databricks, PySpark, Python, SQL, Spark, and Delta Lake. Develop transformations, orchestration workflows, data models, validation processes, and curated data products. Troubleshoot performance and quality issues, apply governance and security practices, document solutions, and collaborate with architects, data scientists, DevOps teams, analysts, and clients.

Build and operate data platform services, APIs, SDKs, schemas, validation tools, event-driven pipelines, and reverse ETL workflows. Improve Kafka-based data delivery, schema evolution, observability, lineage, access controls, privacy, and compliance. Partner with engineering, analytics, data science, security, and infrastructure teams to create reliable, self-service data workflows. Operate AWS services, infrastructure as code, monitoring, alerting, and incident response.

Leads the design, development, and optimization of scalable data pipelines and analytics platforms. Builds ETL/ELT workflows using Databricks and Spark, integrates and transforms source data into curated models, manages SQL Server data, and maintains documentation and lineage. Collaborates with product, analytics, and engineering teams to deliver reliable data solutions. Applies responsible AI practices and delivers projects independently within established timelines.

Build and lead Greenlight Rent’s data foundations, including event models, ingestion, warehouses, transformations, APIs, services, and data products. Ensure data reliability, security, compliance, and correctness for financial reporting and business operations. Partner with product, finance, and operations to deliver measurable outcomes, make technical tradeoffs, establish engineering and data-quality standards, mentor engineers, and lead high-impact projects while remaining hands-on in production software development.

Designs, builds, and maintains scalable batch and streaming data pipelines across AWS and GCP. Develops ETL/ELT workflows using Python, PySpark, and advanced SQL; optimizes performance, storage, and query execution; implements data quality and governance controls; and supports data lakes, warehouses, and ML workflows. Collaborates with data scientists and ML engineers on MLOps automation and production deployments while maintaining CI/CD, Docker, infrastructure standards, and technical documentation.

Lead Cohere’s Data Foundation pillar, managing a team responsible for the full data lifecycle. Own the roadmap, BigQuery warehouse, Airflow and Cloud Run orchestration, dbt modeling, Looker and API serving, Terraform infrastructure, governance, access controls, reliability, incident response, and data freshness SLAs. Lead development of an agentic analytics platform and evaluation framework, establish company-wide analytics standards, and partner with product, engineering, security, legal, and business teams.

Build and lead scalable data and machine learning systems for an AI platform automating product regulatory compliance. Responsibilities include designing system architecture, selecting technologies, developing backend and internal services, collaborating with data and ML engineers, and balancing speed with scalability. The role requires strong Python, database, microservices, AWS, and Docker expertise, along with startup product development experience and technical leadership.

Own the strategy and architecture for a scalable, multi-cloud data platform across Revv and AirPro. Integrate Azure SQL Server data with AWS, Fivetran, dbt, and Snowflake pipelines; build trusted dbt models; connect Salesforce and ERP systems; and establish governance, quality, ownership, and compliance foundations. Partner with analytics, finance, sales, product, and engineering leadership to translate business needs into reliable data assets and customer-facing products.

Designs, builds, and supports Python-based ETL and ELT pipelines on AWS. Responsibilities include developing an S3-based data lake with Apache Iceberg, managing Glue metadata, creating Athena reporting datasets, implementing data quality controls, and supporting QuickSight analytics. The role collaborates with business and technical stakeholders, establishes governance and security practices, monitors production pipeline reliability, and tunes data performance. Experience with dbt, Snowflake, financial data standards, and regulated environments is desirable.

Own and evolve UJET’s data platform, including MySQL CDC replication to BigQuery, dbt transformations, Terraform infrastructure, pipelines, data quality, observability, and Looker models. Build reliable, analytics-ready datasets and trusted metrics for internal and customer-facing reporting. Partner with Analytics, Finance, Product, and Engineering to deliver scalable data solutions, improve platform reliability, optimize performance and costs, and establish development standards and guardrails.

Designs, develops, and optimizes scalable data platforms, pipelines, ETL/ELT workflows, and Lakehouse architectures using Azure Databricks, Spark, and cloud services. Builds data models, quality and governance frameworks, integrations, and secure access controls. Optimizes workloads, supports streaming and analytics initiatives, troubleshoots pipelines, and contributes to CI/CD, DevOps, infrastructure automation, documentation, and technical leadership.

Own and evolve WorkOS’s internal data platform, including ingestion, orchestration, Snowflake, dbt models, data governance, reverse ETL, semantic views, and AI-enabled data workflows. Ensure pipeline reliability, freshness, security, and scalability while partnering with Product, Finance, RevOps, GTM, Engineering, and Security. Build monitoring, runbooks, CI/CD gates, access controls, masking policies, and infrastructure automation across AWS and Kubernetes.

Build and optimize batch and streaming data pipelines, ETL/ELT processes, data models, and analytics solutions on Google Cloud. Support Vertex AI and Gemini-based ML solutions, MLOps, prompt engineering, embeddings, and RAG experimentation. Participate in client requirements gathering, architecture implementation, data governance, quality validation, security, monitoring, and documentation while collaborating with senior engineers and architects.