Top Data Engineer Jobs in NYC, NY

Lead production data engineering workstreams for AI-enabled financial services solutions. Design Python and SQL pipelines, warehouse and lakehouse models, document ingestion and retrieval-ready data foundations. Implement data quality, lineage, access controls, testing, deployment, monitoring, and recovery processes. Mentor engineers, manage technical delivery, collaborate with clients and vendors, and contribute to reusable assets, proposals, and implementation roadmaps.

Build and maintain scalable data pipelines from financial data vendors into Snowflake and Databricks gold tables supporting machine learning. Lead end-to-end projects involving LLMs, RAG, and AI technologies; implement CI/CD, infrastructure-as-code, containerization, testing, monitoring, and cloud-native deployments. Collaborate with stakeholders, ensure data quality, mentor junior engineers, and travel up to 20% to support distributed teams.

Own Eve’s data platform end to end, including ingestion, orchestration, incremental dbt models, Snowflake administration, Terraform infrastructure, observability, access controls, and pipeline reliability. Build schema-change detection, freshness SLAs, CI environments, and incident processes while managing performance and compute costs. Partner with analytics engineers and stakeholders to maintain trusted data for reporting and AI systems, using AI-assisted development and documenting platform standards.

Build and operate scalable cloud data platforms, pipelines, and applications using Python, Spark, SQL, Databricks, Snowflake, and relational and NoSQL databases. Design data models, enforce engineering patterns and security standards, support distributed and streaming workloads, and deliver resilient solutions. Collaborate with product managers, software engineers, analysts, and data scientists while mentoring teammates and communicating technical concepts to stakeholders.

Design, build, and operate scalable cloud data platforms, pipelines, and applications. Collaborate with data scientists, analysts, engineers, and product managers while applying distributed computing, lakehouse architecture, data modeling, security, and observability practices. Develop resilient relational and NoSQL data solutions, mentor team members, enforce engineering standards, and communicate technical outcomes to stakeholders. The role requires independent delivery of cloud-first data products supporting large-scale financial experiences.

Designs and optimizes scalable data pipelines, services, and models using Python and SQL. Ensures data quality, reliability, and performance across large-scale storage and processing systems. Collaborates with analysts, data scientists, engineers, and cross-functional teams to deliver actionable data solutions. Integrates LLM and agent-based capabilities into data platforms and supports clinical, business intelligence, and operational needs.

Designs, builds, operates, and modernizes secure ETL/ELT data pipelines for public health interoperability. Responsibilities include using NiFi, Kafka, Python, and SQL; deploying pipelines on Azure or AWS; implementing CI/CD with GitHub Actions; monitoring with Grafana; troubleshooting production systems; supporting legacy migrations; and ensuring data security, compliance, scalability, and reliability. The role collaborates with architects, integration engineers, data scientists, DevOps/SRE, and product teams.

The AVP, Data Engineer will design and build data ingestion, transformation, and replication pipelines using SQL, Python, dbt, and Dagster. Responsibilities include translating requirements into technical designs, developing data products, debugging production issues, supporting testing, and improving data engineering practices. The role also involves data modeling, mentoring junior engineers, conducting code reviews, and providing technical leadership while remaining hands-on. Experience with modern data platforms, workflow orchestration, cloud ecosystems, and insurance or financial services is preferred.

Leads data architecture and engineering modernization across business domains. Designs and implements complex pipelines, integrations, data models, and orchestration using Snowflake, AWS, and Airflow. Establishes data quality, governance, security, testing, observability, CI/CD, and reliability practices. Provides architectural guidance, evaluates technical solutions, leads cross-team initiatives, mentors engineers, and improves platform performance and cost efficiency.

Build and maintain production ETL pipelines for structured and unstructured data, integrate machine learning models for enrichment, develop data transformations and quality monitoring, design warehouses and dimensional models, establish governance frameworks, and contribute to data architecture and platform improvements. Collaborate with data scientists, analysts, and engineering teams to deliver reliable, actionable intelligence.

Leads the architecture, development, and production operation of complex data pipelines and platforms. Resolves scalability, data quality, reliability, and architectural challenges; evaluates data technologies; mentors engineers; establishes engineering standards; partners with product, analytics, and operations teams; communicates technical trade-offs; and conducts proofs of concept to guide platform strategy.

Architect and own marketing data infrastructure, including Databricks pipelines, Gold Layer tables, semantic models, and trusted analytics foundations. Lead cross-functional data initiatives, translate ambiguous business needs into scalable solutions, ensure data quality and reliability, and mentor engineers and analysts. Build, evaluate, and monitor production LLM and agent systems, automate marketing workflows with AI, and deliver high-quality Python and SQL solutions supporting Marketing, Sales, and R&D.

Build and maintain scalable Snowflake-based ELT/ETL pipelines, production data models, and observability frameworks. Translate business requirements into reliable solutions supporting analytics, BI, and ML. Establish data quality, governance, lineage, security, and compliance practices while optimizing warehouse performance, cost, and data freshness. Collaborate with Analytics, Product, and Engineering teams, contribute to architecture decisions, evaluate Snowflake tooling, and use AI-assisted development tools to accelerate delivery.

Designs, builds, and optimizes scalable data collection, storage, access, and analytics systems. Creates and automates reliable data pipelines, supports data quality and governance, ensures SLA and performance compliance, and monitors pipeline operations. The role requires collaboration with analytics, business, and customer teams, with potential work involving AI/ML pipelines, Databricks, DevOps practices, streaming data, and event-driven architectures.

Build and maintain scalable batch and incremental data pipelines using Python, SQL, and Snowflake. Develop data warehouse models, transformations, automation, quality checks, lineage, alerting, and performance optimizations. Collaborate with analysts, data scientists, and application teams to deliver trusted datasets, while documenting pipelines, schemas, and data contracts.

Build and maintain scalable batch and incremental data pipelines using Python, SQL, and Snowflake. Develop warehouse models, transformations, automation, data quality checks, lineage, alerting, and performance optimizations. Collaborate with analysts, data scientists, and application teams to deliver trusted datasets, while documenting pipelines, schemas, and data contracts.

Designs and maintains a scalable data platform supporting analytics, machine learning, and AI workloads. Builds tooling for reliable data pipelines, semantic layers, data agents, LLM applications, and evaluation systems. Ensures data quality, availability, observability, and reliability while establishing modeling, testing, and platform best practices. Collaborates with Data Science and Product Engineering, leads solutions from design through implementation, and contributes individually in a fast-paced startup environment.

Build, test, and maintain batch and event-driven data pipelines and ETL/ELT workflows. Transform and validate large datasets, troubleshoot data-quality issues, improve workflow reliability, and support platform modernization. Collaborate with engineering, product, and data stakeholders while following strong practices for version control, testing, monitoring, documentation, and code review. The role may occasionally require work outside standard business hours.

Own EULER’s data lifecycle, including instrumentation, validation, reconciliation, privacy, anonymization, canonical data modeling, analytics datasets, documentation, and production pipelines. The role requires strong SQL, software engineering practices, independent ownership, skepticism toward data quality, and clear communication. Preferred experience includes GDPR/LGPD, multi-tenant B2B SaaS, dbt, statistics, Cloudflare Workers, Postgres, Parquet, DuckDB, and Bubble.

Build and maintain scalable batch and streaming data pipelines, analytics warehouses, transformation layers, and dimensional data models. Perform SQL-based analysis, support dashboards and reporting, monitor data quality and delivery SLAs, troubleshoot incidents, and improve operational reliability. Collaborate with engineers, analysts, data scientists, and business stakeholders while contributing to documentation, governance, observability, and automation.

Build scalable data ingestion, transformation, and loading infrastructure using Spark, SQL, AWS, and Databricks. Develop entity resolution systems, CI/CD pipelines, anomaly detection, and data quality processes. Design scalable processing systems, orchestration workflows, storage patterns, and data warehouse solutions. Collaborate remotely, document technical designs, scope projects, and solve complex data engineering and data science problems.

Build and scale distributed data pipelines and architectures supporting AI products and research. Responsibilities include processing large datasets with Spark, designing AWS data systems, managing SQL and NoSQL storage, writing Python and SQL, ensuring data quality and reliability, and implementing automation, orchestration, monitoring, and scalable data operations.

Design, build, and operate scalable batch and streaming data pipelines, lakehouse and warehouse models, and data services. Own datasets end to end, improve Snowflake, Iceberg, Spark, and Flink performance and reliability, implement governance and observability, and support graph-serving data models. Partner with product and engineering teams, participate in on-call, review code and designs, and mentor junior engineers.

Build and maintain reliable data pipelines supporting money movement, fraud response, and client reporting. Integrate internal and external APIs, orchestrate workflows with Airflow on Kubernetes, and implement testing, monitoring, alerting, and observability. Debug production issues, document root causes, improve pipeline efficiency, collaborate with stakeholders, and contribute to technical designs. The role requires Python, SQL, Airflow, Snowflake, dbt, and GCP experience, with opportunities for increased end-to-end ownership.

Build and maintain large-scale data processing pipelines using Apache Spark (PySpark/Scala) and Python. Design ETL workflows, implement distributed data processing, use version control (Git), and work with cloud platforms (GCP/AWS/Azure).