Top Data Engineer Jobs in NYC, NY

Design and optimize Snowflake data warehouses, dbt transformation models, and scalable ETL/ELT pipelines. Develop ingestion utilities, improve SQL and warehouse performance, establish data quality and governance controls, and maintain CI/CD workflows using Git. Collaborate with analysts, data scientists, and business stakeholders across manufacturing, supply chain, and operations. The role also supports modern DataOps practices and may involve orchestration tools and cloud platforms.

Build and maintain scalable ETL/ELT pipelines using Azure Data Factory, Snowflake, dbt, and SQL. Develop data models, transformations, tests, and documentation; ingest data from APIs, databases, files, and enterprise applications; optimize performance; ensure data quality; troubleshoot failures; and support production deployments and monitoring.

Design, build, and maintain Keboola-based data pipelines integrating multiple business systems to deliver accurate, scalable data for supply chain, logistics, and transportation analytics; collaborate with analysts and engineers; support documentation, governance, and pipeline automation.

Designs, builds, tests, maintains, and optimizes large-scale data pipelines, ETL processes, ingestion workflows, and cloud data storage. Develops Databricks data engineering and AI/ML pipelines, Azure Data Lake solutions, Power BI dashboards, and CI/CD automation. Ensures data quality, security, scalability, cost efficiency, and reusable engineering practices while collaborating with distributed technical teams.

Build, model, and maintain scalable BigQuery-based data solutions on GCP. Implement performant data models, storage partitioning/clustering, ETL improvements, data validation, and documentation. Collaborate with architects, data scientists, and engineers to deliver governed, high-quality data for reporting and AI initiatives.

Builds and maintains scalable batch and streaming data pipelines supporting analytics, machine learning, and business operations. Responsibilities include writing Python, SQL, and Spark code; ensuring data quality and reliability; monitoring and troubleshooting pipelines; implementing testing and observability practices; documenting data architecture; and collaborating with analysts, data scientists, product managers, and engineering teams in an agile environment.

Build and own Stuut’s data infrastructure, including ingestion pipelines, canonical data models, semantic layers, event pipelines, quality testing, observability, and DataOps practices. Partner with product, engineering, and ML teams to deliver reliable datasets, dashboards, KPIs, and insights. This foundational role will establish the company’s data architecture and scale it as customer adoption grows.

Designs, builds, deploys, and maintains scalable data architectures, databases, ETL/ELT pipelines, API integrations, and cloud data solutions in AWS GovCloud. Migrates on-premises databases to cloud platforms, optimizes data models and performance, implements governance and security controls, and supports reporting and analytics. Collaborates with architects, data scientists, and stakeholders while documenting systems and conducting integration, validation, cost, and risk assessments.

Designs, builds, and maintains cloud data pipelines and ETL/ELT processes supporting VA healthcare analytics. Responsibilities include patient matching, record linkage, data harmonization, quality management, documentation, performance optimization, and pipeline support. Collaborates with analysts and stakeholders to develop scalable solutions and Power BI reports using Databricks SparkSQL. The role requires federal healthcare data experience, strong SQL or Spark SQL skills, and the ability to obtain a VA Public Trust clearance.

Entry-level data engineering development program involving three rotations, cloud-native data platforms, batch and real-time pipelines, distributed systems, ETL/ELT, data modeling, AI platforms, and enterprise data products. Participants use AWS, Spark, Java, Python, SQL, Snowflake, Kafka, and related technologies while gaining experience with LLM architectures, APIs, microservices, and secure production deployments.

Data Engineer Interns will gain hands-on experience building batch and real-time data pipelines using AWS, Spark, Java, Python, and SQL. They will learn data modeling, ETL/ELT, distributed systems, streaming technologies, and AI platforms, including LLM, RAG, vector database, and agentic AI architectures. Interns will collaborate with data engineers, contribute to secure data and AI solutions, and participate in mentorship and professional development activities.

Supports the design and development of scalable end-to-end data pipelines and cloud data platforms. Responsibilities include improving data reliability and quality, implementing data management practices, supporting automation and process improvements, ensuring secure and cost-effective solutions, and recommending system enhancements. The intern collaborates with global teams and gains hands-on experience in data engineering, project coordination, and innovation management.

The Principal Data Engineer designs and builds scalable cloud-native data platforms, pipelines, frameworks, and governed data products supporting analytics, reporting, AI, and operational workloads. Responsibilities include Databricks, Spark, Delta Lake, Azure, SQL Server, batch and streaming processing, data integration, performance optimization, governance, modernization, troubleshooting, architecture reviews, and mentorship. The role provides senior technical leadership without direct people management and supports insurance-domain data across policy, claims, billing, finance, and regulatory functions.

Build and maintain scalable data platforms and systems that transform raw market data into validated analytical datasets, including bars, residuals, curves, volatility surfaces, and greeks. Collaborate with trading, research, and external vendor teams to understand datasets and workflows, implement calculations, document technical solutions, and ensure reliable delivery through strong testing and validation practices.

Build and maintain centralized, validated data platforms covering reference, fundamental, market, index, exchange, instrument, and security master datasets. Analyze vendor data, design scalable data models, implement quality controls, resolve processing issues, and partner with quantitative researchers and traders. Provide technical leadership and mentorship while maintaining testing and system design standards across the Core Data team.

Build and maintain scalable ETL/ELT pipelines and data workflows using Python, PySpark, and SQL. Improve data quality, reliability, architecture, and governance while supporting analytics, reporting, and machine learning initiatives. Collaborate with data scientists, analysts, and business stakeholders, use Azure DevOps for CI/CD and release management, and mentor junior engineers. The role also involves API integration, cloud data platforms, testing, version control, and contributing to engineering best practices.

The Senior Data Platform Engineer will design, maintain, and enhance Hinge's data platform, including data pipelines, monitoring systems, and user feedback incorporation while ensuring data quality and system reliability.

Build and configure a government Databricks workspace, develop ingestion pipelines from enterprise systems, and prepare data for reporting. Implement Unity Catalog governance, metadata, auditing, and lineage; configure MLflow workflows; assess security controls for sensitive data; and create architecture documentation, data dictionaries, and operating procedures. The role also requires integrating legacy systems, optimizing Delta Lake pipelines, and supporting long-term platform sustainment.

Performs data engineering operations including SQL scripting, ETL and data validation, query optimization, data analysis, dashboard maintenance, task-result validation, and troubleshooting with engineering and DBA teams. Ensures data integrity and compliance, manages ticket-based assignments, and supports data production and implementations. The role may require after-hours or weekend support and includes preferred experience with network security platforms, certificate management, and automation scripting.

Designs and maintains ELT pipelines, warehouse integrations, data models, and data quality processes. Collaborates with data scientists, analysts, engineers, and stakeholders to deliver scalable analytical solutions. Responsibilities include data integration, governance, security, performance optimization, exploratory analysis, visualization, and cloud-based API ingestion. Requires strong SQL, DBT, Snowflake, Azure Data Factory, cloud, and scripting experience, plus leadership and communication skills.

Build and maintain production data pipelines, Airflow DAGs, Snowflake infrastructure, and Data Vault 2.0 models. Ensure data quality, observability, security, governance, reliability, and cost efficiency through automated testing and CI/CD. Lead technical projects end-to-end, collaborate with stakeholders, and support SOX-relevant reporting while developing expertise in commercial insurance data and processes.

The Forward Deployed Data Engineer will manage AI-automated data platform migration projects, ensuring timely delivery and communication with clients while utilizing proprietary tools.

Build and maintain batch and streaming data pipelines using Databricks, Spark, PySpark, and SQL. Develop AI-assisted ingestion, data-quality repair, document extraction, and human-review workflows. Manage Delta Lake storage, Unity Catalog metadata, geospatial processing, governance, lineage, orchestration, monitoring, CI/CD, and production support. Collaborate with architects and data scientists to operationalize a governed lakehouse platform for pipeline asset integrity data.

Manage Oracle and PostgreSQL databases across on-premises and AWS environments, including upgrades, migrations, performance tuning, security, and backup recovery. Design and maintain ETL pipelines using Talend, SQL, Power Automate, and related tools. Perform data profiling, quality analysis, governance, and cloud migration activities. Create technical architecture and lineage documentation while supporting regulated, audit-ready data platforms and integrations.

Build and operate reliable ETL and ELT pipelines across lakehouse and transactional systems. Develop data models, enforce governance, integrate diverse data sources, and support analytics, APIs, and predictive tools. Monitor performance, data quality, lineage, cost, and uptime while collaborating with data science, AI, product, and innovation teams.