Responsible for designing, developing, and maintaining scalable data pipelines and infrastructure, implementing data governance, and collaborating with teams to meet data needs.
About the Role
We are seeking an experienced Senior Data Engineer to join our growing Data & Analytics team. This role will be responsible for designing, developing and maintaining scalable data pipelines and infrastructure to support our organization’s data needs.
Specific Responsibilities:
- Design, develop, and maintain robust data pipelines and infrastructure to support data integration, processing, and storage
- Collaborate with analysts and other stakeholders to understand data requirements and translate them into technical solutions
- Implement best practices for data governance, security, and quality assurance to ensure the reliability and accuracy of data
- Explore and evaluate new technologies and tools to enhance our data infrastructure and capabilities
- Design and implement complex data models on Azure Synapse Analytics to support data warehousing Utilize Azure DevOps for continuous integration, continuous delivery, and agile project management.
- Manage and optimize Apache Spark pools for high-performance data processing tasks.
- Develop and maintain ETL processes and data pipelines using Python scripting.
- Ensure data quality and integrity across all platforms and systems.
- Collaborate with cross-functional teams to translate business needs into technical specifications.
- Stay current with industry trends and advancements in Azure data services.
What you'll need:
- Bachelor’s degree in Computer Science, Engineering, or related field
- Minimum of 5+ years experience in data engineering roles, with a strong focus on building and maintaining data pipelines and infrastructure
- Strong proficiency in Azure Synapse Analytics, Azure DevOps, and Apache Spark pools.
- Expertise in Python scripting and other programming languages such as SQL and Java
- Senior level knowledge of data modeling, processes, and data warehouse concepts
- Strong communication skills and ability to effectively communicate technical concepts to non-technical stakeholders
- Experience with data modeling, warehousing, and building ETL pipelines
- Familiarity with Azure Data Factory, Azure Data Lake Storage, and other Azure data services
Note for Current Employees:
Please use the internal job board in Greenhouse to apply. Applications submitted through this external link will not be tagged as internal.
Compensation, Benefits, & Additional Details:
Health-E Commerce's compensation philosophy is grounded in market data and internal equity to ensure fairness and consistency across the team. Individuals new to the company should generally expect offers to fall between the entry point and midpoint of the salary range. Our goal is to provide an offer that supports growth potential within the role and allows for future salary progression.
- Compensation: $130,000 - $165,000
- Discretionary Annual Bonus Eligibility: Up to 10%
- Medical, Dental, Vision, and 401K with a company match
- Dependent Care, FSA & HSA accounts
- Paid Parental & Bonding Leave
- Flexible PTO & office closure on all major holidays
- Monthly wellness & internet reimbursements
- Professional development including certification support & leadership coaching
- Mental Health resources
- 100% remote within the United States
- Must be able to work EST hours
Candidate Privacy Notice
Health-E Commerce New York, New York, USA Office
New York, United States
Similar Jobs
.png){kind=logo}
AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
Designs, builds, and supports scalable data pipelines, cloud-native processing systems, data models, APIs, and analytics solutions. The role ensures data quality, observability, testing, governance, CI/CD, and production reliability while partnering with engineering, product, analytics, BI, and business stakeholders. Responsibilities include architecture decisions, troubleshooting, documentation, Agile delivery, incident response, and mentoring engineers.
Top Skills:
Amazon AthenaAmazon EmrAmazon MwaaAmazon RedshiftAmazon SnsAmazon SqsApache AirflowApache HiveApache IcebergSparkAPIsAws GlueAws LambdaAws S3Aws Step FunctionsCi/CdDatabricksGithub ActionsInfrastructure As CodeJavaLookerMicrostrategyPostgresScalaSinglestoreSnowflakeSQLTableau
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Designs scalable data architectures, ELT/ETL pipelines, data models, quality frameworks, and self-service data platforms. Partners with engineering, product, program, leadership, and data science teams to translate business needs into technical solutions. The role includes end-to-end technical ownership, large-scale batch and streaming data processing, mentoring junior engineers, system optimization, and on-call support for platform stability.
Top Skills:
Amazon RedshiftApache AirflowBatch ProcessingBitbucketCi/CdData LakesDatabricksDatabricks ApisDynamoDBGitMachine LearningMongoDBPostgresPythonScalaSparkSQLStreaming
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Designs, develops, deploys, and supports scalable cloud data engineering solutions for HEDIS processing and healthcare quality reporting. Builds ETL pipelines, data integrations, SQL transformations, and AI-enabled workflow automation. Collaborates with stakeholders, auditors, and product teams to ensure data quality, regulatory compliance, and operational reliability. Troubleshoots production issues, supports cloud modernization, applies CI/CD and testing practices, and mentors engineers as a senior individual contributor.
Top Skills:
Agentic AiAICi/CdDatabricksETLFhirGenaiAzureSQL
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
