i4DM Logo

i4DM

SQL Developer / Database Engineer

Posted 8 Days Ago
Remote
Hiring Remotely in USA
Senior level
Remote
Hiring Remotely in USA
Senior level
Designs, maintains, and optimizes SQL Server databases, ETL/ELT workflows, and enterprise data pipelines supporting a federal multi-cloud analytics platform. Integrates structured and unstructured data using Azure, Databricks, Starburst, and data lakes; troubleshoots failures, tunes performance, applies data-quality and governance controls, and supports analytics, reporting, and machine-learning use cases. Translates business requirements into technical solutions and documents data products, pipelines, and operational procedures.
The summary above was generated by AI
Description

About the Role

We are seeking an experienced SQL Developer / Database Engineer to support ATLAS, the VA’s open-architected, multi-cloud enterprise data management and analytics platform. In this role, you will design, maintain, integrate, and optimize SQL database structures, transformation logic, and data pipelines that ingest, condition, curate, and deliver multi-source data as secure, reusable enterprise data products. You will use SQL Server, Azure Data Factory, Synapse Pipelines, Databricks, Starburst, and Azure Data Lake Service to improve data reliability, performance, and interoperability across ATLAS and connected source platforms. You will troubleshoot discrepancies and ETL/ELT failures, translate business requirements into technical solutions, and help provide consistent access to trusted data that supports analytics, evidence-based decisions, and better outcomes for Veterans and their families.


Key Responsibilities

  • Design, install, configure, maintain, and optimize SQL database systems and related data structures supporting ATLAS.
  • Develop, maintain, monitor, and troubleshoot ETL/ELT workflows and data pipelines using Azure Data Factory and Synapse Pipelines.
  • Integrate structured and unstructured data from databases, APIs, cloud platforms, and other enterprise sources into Azure Data Lake Service.
  • Create and optimize complex SQL queries, stored procedures, database objects, and transformation logic for data conditioning and curation.
  • Use Databricks and Starburst to query, transform, and integrate distributed data across lakehouse and enterprise data sources.
  • Investigate data discrepancies, pipeline failures, and performance issues; perform root-cause analysis and implement durable fixes.
  • Apply data-quality controls and support metadata management and data cataloging using Collibra.
  • Monitor database and pipeline performance; perform query tuning, indexing, backup, recovery, patching, and reliability improvements.
  • Support secure, consistent, and compliant access to enterprise data through appropriate identity, authorization, and data-protection controls.
  • Collaborate with data engineers, analysts, data scientists, and product teams to create consumable data products and enable Azure ML/AI services.
  • Support reporting and visualization needs using Pyramid Analytics and Power BI, including validation of underlying data structures and accuracy.
  • Translate business requirements into technical specifications and communicate solutions clearly to technical and non-technical stakeholders.
  • Document database structures, data mappings, pipelines, operational procedures, and technical decisions.
  • Participate actively in Agile/Scrum ceremonies and support continuous improvement of ATLAS data services.


Requirements

Minimum Qualifications

  • Minimum five (5) years of experience in database development, administration, and maintenance.
  • Strong experience with Microsoft SQL Server, including complex SQL queries, stored procedures, database design, indexing, optimization, and performance tuning.
  • Experience developing and troubleshooting data integrations, ETL/ELT processes, and SSIS packages.
  • Hands-on experience creating, updating, monitoring, and troubleshooting Azure Data Factory and Synapse Pipelines.
  • Experience with Databricks, Starburst, Azure Data Lake Service, and distributed or large-scale datasets.
  • Experience with Collibra for data cataloging, metadata management, or data governance.
  • Experience supporting Azure ML/AI services and preparing reliable data for analytics or machine-learning use cases.
  • Experience supporting Pyramid Analytics and Power BI visualization solutions and validating source data.
  • Excellent troubleshooting and root-cause analysis skills.
  • Ability to understand business requirements and translate them into technical specifications.
  • Ability to communicate technical details to non-technical users and stakeholders, with excellent written and verbal communication skills.
  • Ability to obtain and maintain a Public Trust or Suitability/Fitness determination based on client requirements.

Preferred Qualifications

  • Experience supporting federal agencies, the Department of Veterans Affairs, or other regulated environments.
  • Experience with enterprise data lakes, lakehouses, Delta Lake, Parquet, and multi-cloud data integration.
  • Experience working independently and collaboratively within Agile data-product teams.


What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account