Build and maintain scalable ETL/ELT pipelines using Azure Data Factory, Snowflake, dbt, and SQL. Develop data models, transformations, tests, and documentation; ingest data from APIs, databases, files, and enterprise applications; optimize performance; ensure data quality; troubleshoot failures; and support production deployments and monitoring.
This is a remote position.
We are looking for an experienced Data Engineer with strong hands-on experience in Azure Data Factory (ADF), Snowflake, dbt, and SQL. The ideal candidate will be responsible for building and maintaining scalable data pipelines, transforming data, and developing reliable data solutions for analytics and reporting.
- Design, develop, and maintain ETL/ELT data pipelines using Azure Data Factory (ADF).
- Build and optimize data solutions using Snowflake as the cloud data warehouse.
- Develop data transformation models using dbt (Data Build Tool).
- Write complex and optimized SQL queries, stored procedures, views, and transformations.
- Develop data pipelines to ingest data from various sources including APIs, databases, files, and enterprise applications.
- Perform data cleansing, transformation, validation, and reconciliation to ensure data quality and accuracy.
- Implement incremental data loads, scheduling, dependency management, and error handling in ADF.
- Develop scalable and optimized Snowflake data models, tables, views, and SQL transformations.
- Build and maintain dbt models, tests, macros, and documentation.
- Troubleshoot pipeline failures, data issues, and performance problems across ADF, Snowflake, and dbt.
- Work with business analysts, data architects, and other engineering teams to understand data requirements and deliver solutions.
- Support production deployments, monitoring, and ongoing enhancement of data pipelines.
- 4+ years of experience in Data Engineering.
- Strong hands-on experience with:
- Azure Data Factory (ADF)
- Snowflake
- dbt
- Advanced SQL
- Azure Data Factory (ADF)
- Strong understanding of ETL/ELT concepts and data warehousing.
- Experience developing complex data pipelines and data transformations.
- Good understanding of dimensional data modeling, including fact and dimension tables.
- Experience with Snowflake performance optimization and query tuning.
- Hands-on experience with dbt models, tests, incremental models, macros, and Jinja.
- Strong troubleshooting and production support skills.
- Experience with Azure cloud services, particularly Azure Storage, Azure Functions, Databricks, or Key Vault.
- Experience integrating data through REST APIs, JSON, CSV, and relational databases.
- Experience with Python or PySpark is a plus.
- Experience with Git and CI/CD using Azure DevOps or similar tools.
- Understanding of data governance, data quality, and security best practices.
- Experience working with large-scale enterprise data platforms.
Similar Jobs
Healthtech • Logistics • Pharmaceutical
Leads a major workstream within an enterprise transformation program, overseeing planning, execution, milestones, dependencies, risks, issues, budgets, governance, reporting, and stakeholder coordination. Partners with business, IT, finance, vendors, and implementation teams to ensure timely, high-quality delivery and operational readiness. Manages workstream financials, forecasts, variances, and audit-ready controls while driving accountability and adoption across a complex matrixed environment.
Top Skills:
Erp
Artificial Intelligence • Cloud • Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Evaluates life and disability insurance applications, assesses medical and mortality risks, determines eligibility and underwriting decisions within authority limits, reviews contestable claims, requests additional documentation, and communicates with internal teams and third-party administrators. The role also maintains underwriting records, meets production and service standards, trains new underwriters, and applies medical underwriting guidelines to complex, non-standard applications.
Healthtech • Software • Biotech • Pharmaceutical
Provides oncology and genomics expertise to guide Flatiron Health product development. Interprets genomic test results, translates clinical workflows into product requirements, validates clinical features, supports precision medicine education, and collaborates with Product, Engineering, and Clinical teams. The role also develops training resources, informs clinical decision support, and represents provider needs throughout product development. This is a remote, six-month contract with intermittent travel for practice engagements and product go-lives.
Top Skills:
Flatiron AssistGermline Genomic TestingMolecular DiagnosticsNext-Generation Sequencing (Ngs)OncoemrPrecision MedicineSomatic Genomic Testing
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
