Dynatrace Logo

Dynatrace

Lead Data Engineer

Posted Yesterday
Be an Early Applicant
Remote or Hybrid
Hiring Remotely in Boston, MA
150K-180K Annually
Senior level
Remote or Hybrid
Hiring Remotely in Boston, MA
150K-180K Annually
Senior level
The Lead Data Engineer designs and builds data pipelines, manages Snowflake as core data platform, and ensures data observability for AI systems at enterprise scale.
The summary above was generated by AI
Your role at Dynatrace

The Data Engineer builds the foundation for everything else that sits on. Without clean, well-structured, timely data, there are no models to train, no experiments to run, and no products to ship. You design, build, and operate the pipelines, data platforms, and transformation layers that power the team's AI systems — and you do this at enterprise scale, not just in sandboxed environments. You have a track record of moving beyond PoC data work into hardened production infrastructure: systems that handle real data volumes, real failure modes, and real business SLAs. You treat data lineage, contracts, and observability as engineering requirements — not afterthoughts. Snowflake is your primary platform; you know it deeply, including Cortex. This role will report up into the VP of AI, Collaboration and Data's team.

Your role at Dynatrace:

  • Architect and operate Snowflake as the core data platform — including Snowpark for ML, Cortex LLM functions, Cortex Search, and Dynamic Tables for AI-ready data products.
  • Design and maintain batch and streaming data pipelines for ingestion, transformation, and delivery of training and inference data at enterprise scale.
  • Build and own dbt transformation layers: modular data models, tests, documentation, and CI/CD-integrated dbt deployments — including data contracts that define and enforce schema agreements between data producers and consumers.
  • Maintain full data lineage from source to training artefact to inference endpoint — enabling reproducibility, auditability, and root-cause analysis when model quality degrades.
  • Implement AI data observability across all pipelines: data freshness monitoring, volume anomaly detection, schema drift alerting, and data quality SLAs using dbt tests, Great Expectations, or equivalent tooling.
  • Design and expose MCP (Model Context Protocol) servers on top of Snowflake data assets — enabling AI agents to query, retrieve, and act on enterprise data securely and reliably, with access-controlled and auditable tool interfaces.
  • Build and maintain Power BI dataflows and semantic models that connect Snowflake data to business-facing dashboards and operational reports.
  • Build and operate feature stores and vector databases that serve both model training and real-time RAG inference — with lineage, versioning, and responsible data governance policies covering PII handling, consent, and data retention.
  • Manage data access controls, anonymization, and governance policies — ensuring all datasets used for AI training and inference comply with data protection regulations and responsible AI standards.
  • Optimize Snowflake and AWS compute costs and query performance; implement credit governance, resource monitoring, and cost allocation for AI workloads.

This is a remote eligible position. Candidates who live within a 45 mile radius of Boston, MA; Detroit, MI; Denver, CO; and Mountain View, CA will be required to work hybrid (2 days per week) out of our Dyntrace office. Candidates are required to work EST hours for this position.

What will help you succeed

Minimum Requirements:

  • 5+ years of data engineering experience with proven track record building and operating Snowflake in production at enterprise scale.

Preferred Requirements:

  • Expert-level proficiency in Snowflake (Snowpark, Cortex, Dynamic Tables) and dbt (models, tests, documentation, data contracts, CI/CD integration).
  • Expert-level proficiency in Python and SQL.
  • Experience building and monitoring real-time data pipelines.
  • Hands-on experience with AWS data services (S3, Glue, Lambda, Redshift, SageMaker Pipelines).
  • Proven track record implementing data observability using Great Expectations, dbt tests, or Monte Carlo.
  • Experience with orchestration tools and infrastructure-as-code.
  • Demonstrated experience implementing data lineage and observability on a live platform.
  • Track record applying responsible data governance practices: PII handling, access controls, anonymization, consent tracking, and data retention policies.
  • Experience optimizing cloud compute costs and implementing resource monitoring for large-scale data workloads.
Why you will love being a Dynatracer

• A one-product software company creating real value for the largest enterprises and millions of end customers globally, striving for a world where software works perfectly.
• Working with the latest technologies and at the forefront of innovation in tech on scale; but also, in other areas like marketing, design, or research.
• A team that thinks outside the box, welcomes unconventional ideas, and pushes boundaries.
• An environment that fosters innovation, enables creative collaboration, and allows you to grow.
• A globally unique and tailor-made career development program recognizing your potential, promoting your strengths, and supporting you in achieving your career goals.
• A truly international mindset that is being shaped by the diverse personalities, expertise, and backgrounds of our global team.
• A relocation team that is eager to help you start your journey to a new country, always there to support and by your side.
• Attractive compensation packages and stock purchase options with numerous benefits and advantages.

Compensation and Rewards

DOE, salary $150K - $180K, plus Health, Dental, Life, STD, LTD, 401K, PTO. Total compensation may vary depending on candidate experience/education and location.

Equal Employment Opportunity

All your information will be kept confidential according to EEO guidelines.

We offer competitive compensation, company-sponsored premium benefits, medical, dental, vacation/holidays, company matching 401(k) Plan, etc. Dynatrace is an Equal Opportunity/Affirmative Action employer. All qualified applicants will receive consideration for employment without regard to race, sex, color, gender identity, religion, national origin, ancestry, citizenship, physical abilities, age, sexual orientation, creed, disability status, veteran status, pregnancy, genetic status, or any other characteristic protected by law. If your disability makes it difficult for you to use this site, please contact [email protected]. Dynatrace participates in E-Verify, participant information in English and Spanish. Right to work information in English and Spanish. EEO is the Law. To be considered for this position, please upload your resume/CV.

Top Skills

AWS
Dbt
Glue
Great Expectations
Lambda
Monte Carlo
Power BI
Python
Redshift
S3
Sagemaker
Snowflake
Snowpark
SQL

Similar Jobs at Dynatrace

Yesterday
Remote or Hybrid
Boston, MA, USA
91K-115K Annually
Senior level
91K-115K Annually
Senior level
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Big Data Analytics • Automation
Lead digital measurement strategy for web and digital marketing. Build and maintain dashboards, integrate multi-platform data, perform tagging QA, run A/B test analyses, and deliver insights to optimize campaign effectiveness, UX, and ROAS.
Top Skills: A/B TestingAd PlatformsAdobe AnalyticsCRMGoogle AnalyticsLooker StudioPower BITableauTagging QaWeb Analytics Tracking
Yesterday
Remote or Hybrid
Boston, MA, USA
140K-150K Annually
Senior level
140K-150K Annually
Senior level
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Big Data Analytics • Automation
The Lead Business Operations Analyst will drive operational excellence in Customer Success, analyze data, and implement scalable solutions, collaborating across teams and facilitating meetings to improve processes.
Top Skills: Crm PlatformsCustomer Success Technology Stacks
Yesterday
Remote or Hybrid
Boston, MA, USA
150K-180K Annually
Senior level
150K-180K Annually
Senior level
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Big Data Analytics • Automation
The AI Engineer designs and deploys AI automation tools, partners with teams for workflow automation, and enhances operational efficiency using generative AI and data-driven decision support.
Top Skills: AnthropicApi GatewayAWSAzureDbtEventbridgeGeminiGoLambdaMlflowOpenaiPythonS3SagemakerSnowflakeStep FunctionsTypescriptWeights & Biases

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account