Irth Solutions Logo

Irth Solutions

Data Architect (Mid-Level)

Posted 14 Days Ago
Remote
Hiring Remotely in United States
Senior level
Remote
Hiring Remotely in United States
Senior level
Design and own a unified data model for an AI-driven pipeline risk platform. Responsibilities include lakehouse and medallion architecture, geospatial modeling, entity resolution, ingestion patterns, governance, lineage, data quality, access controls, and traceability. Partner with data engineers, application engineers, and data scientists to implement schemas, pipelines, serving layers, and optimization strategies while maintaining clear architecture documentation.
The summary above was generated by AI

Data Architect – Insights (AI/ML)

Location: Remote (US)
Department: Insights (AI/ML)
Reports to: Engineering Manager

About the Role

Irth is building a new AI-driven threat and risk management platform for pipeline asset integrity. The platform brings together three capabilities that have historically been separate at Irth:

  • A governed, cross-product data platform built on Databricks and Azure
  • An AI-powered ingestion layer that normalizes, repairs, and enriches customer data without services-heavy onboarding
  • A reusable analytical layer that runs industry-standard, Irth-developed, and customer-built risk models against the data

We are seeking a mid-level Data Architect to design the schema and data model that powers this platform. You will create a unified structure spanning asset integrity, damage prevention, and land and stakeholder management, capable of supporting probabilistic risk models that require dozens of precisely defined input attributes per pipeline segment.

This is a hands-on design role. You will establish standards for data lineage, governance, and quality while working closely with the data engineering team to implement them. This role is ideal for someone with substantial experience in lakehouse and medallion architecture who is ready to own the data model for a platform rather than a single project.

Key Responsibilities

1. Data Modeling & Architecture
  • Design the schema and unified data model for the platform, spanning asset, inspection, incident, geospatial, and consequence data across multiple products.
  • Apply medallion architecture patterns (Bronze, Silver, Gold) and define the semantic layer consumed by downstream models, reporting, and applications.
  • Model the data required by probabilistic risk models, ensuring every required input attribute has a defined source, transformation path, and data-quality expectation.
  • Design cross-product entity resolution so records from separate products reconcile to shared assets and entities.
  • Define ingestion patterns for batch, streaming, and change-data-capture (CDC) sources, including schema evolution and slowly changing dimensions.
  • Produce architecture documentation, diagrams, data dictionaries, and decision records that engineers can implement without ambiguity.
2. Geospatial & Domain Data Design
  • Design the shared GIS layer as a first-class component of the data model, including pipeline centerlines, consequence-area polygons, right-of-way corridors, and parcel data.
  • Model linear referencing and dynamic segmentation so risk results align with centerline geometry and can be aggregated across differing segmentations.
  • Define data structures for inspection data, repair history, and external enrichment sources such as weather history, soil characteristics, and satellite-derived data.
3. Governance, Lineage & Data Quality
  • Define cataloging, classification, and metadata standards in Unity Catalog and establish expectations for lineage coverage across the data estate.
  • Establish data-quality rules, validation gates, and profiling standards, including processes for quarantining and remediating failures.
  • Define access-control patterns, including role-based and attribute-based access, tenant isolation, and appropriate handling of sensitive data.
  • Design for end-to-end traceability so that any risk output can be traced through every transformation back to its source record.
4. Implementation Partnership
  • Work directly with data engineers to translate architectural designs into production pipelines and review implementations for conformance.
  • Contribute hands-on to schema deployment, transformation logic, and optimization when it accelerates delivery.
  • Partner with application engineers and data scientists to determine how the data model is consumed through serving layers, feature stores, and APIs.
  • Support performance and cost optimization, including partitioning, clustering, file layout, and compute sizing.
5. Collaboration & Documentation
  • Participate in design reviews and architecture alignment sessions and defend design decisions using data and evidence.
  • Work with subject-matter experts to translate domain and regulatory requirements into concrete data structures and standards.
  • Maintain architecture documentation as the model evolves, treating stale or inaccurate documentation as a defect.

Requirements

Required Qualifications

  • 5–8 years of experience in data architecture, data modeling, or senior data engineering, including end-to-end ownership of a non-trivial data model.
  • Hands-on experience with Databricks, including Delta Lake, Unity Catalog, SQL Warehouses, and pipeline orchestration.
  • Strong command of medallion and lakehouse architecture patterns, dimensional modeling, and semantic layer design.
  • Advanced SQL skills and proficiency in Python or PySpark.
  • Experience with at least one major cloud platform; Azure experience preferred.
  • Practical experience with change data capture (CDC), slowly changing dimensions (SCD), schema evolution, and data-quality frameworks.
  • Working knowledge of data governance, including cataloging, lineage, classification, role-based access control (RBAC), and encryption.
  • Strong documentation and diagramming skills, with the ability to explain data models clearly to both technical and non-technical stakeholders.

Preferred Qualifications

  • Experience designing geospatial data models and working with GIS tooling, spatial joins, and linear referencing.
  • Experience with multi-tenant platforms, data residency requirements, or regulated environments.
  • Familiarity with metadata and lineage tools such as Unity Catalog, Microsoft Purview, or equivalent platforms.
  • Experience modeling data specifically for machine learning or probabilistic risk models.
  • Experience designing semantic layers for business intelligence (BI) consumption.
  • Databricks or cloud data certifications.
  • Experience using AI-assisted coding tools such as Cursor or GitHub Copilot and/or agentic coding tools such as Claude Code as part of a professional development workflow.

Nice to Have

  • Familiarity with pipeline or utility asset data, including inline inspection results, alignment sheets, facilities, and centerline geometry.
  • Understanding of asset integrity concepts such as corrosion growth, defect tracking, and consequence-of-failure modeling.
  • Awareness of regulatory reporting requirements applicable to pipeline integrity data.
  • Experience migrating data from legacy desktop or spreadsheet-based systems.

Success Metrics

Success in this role will be measured by:

  • A documented and implemented data model that supports every required risk-model input attribute with a clearly defined source and transformation path.
  • High lineage coverage and demonstrable traceability from risk outputs back to the originating source records.
  • Data engineers consistently able to build from the architecture and documentation without repeated clarification.
  • Reliable cross-product entity resolution across shared assets and entities.

Similar Jobs

19 Minutes Ago
Remote or Hybrid
United States
17-25 Hourly
Junior
17-25 Hourly
Junior
Artificial Intelligence • Automotive • Greentech • Information Technology • Machine Learning • Software • Cybersecurity
Provides remote technical customer support for Dealertrack and Cox Automotive products through phone, email, and chat. Resolves routine application and product issues, documents cases in CRM, trains customers on product usage, coordinates with internal teams, and follows up through resolution. Requires strong troubleshooting, communication, customer service, and documentation skills, with flexibility for variable shifts, Saturdays, and overtime.
Top Skills: Cox AutomotiveCRMDealertrackGenesys PurecloudSalesforce
19 Minutes Ago
Remote or Hybrid
Illinois, USA
64K-130K Annually
Senior level
64K-130K Annually
Senior level
Artificial Intelligence • Automotive • Greentech • Information Technology • Machine Learning • Software • Cybersecurity
Manages and grows a portfolio of automotive dealer accounts for Autotrader and Kelley Blue Book products. Responsibilities include retaining and expanding subscription revenue, managing sales pipelines and forecasts, conducting ROI reviews, identifying cross-sell and upsell opportunities, providing data-driven consultative guidance, coordinating implementations, and resolving customer issues. The role requires relationship building, territory travel, collaboration across sales teams, and meeting revenue, retention, and referral goals.
Top Skills: Analytic ToolsCRMDigital AdvertisingInternet PlatformsSocial Media
Yesterday
Remote
United States
120K-140K Annually
Mid level
120K-140K Annually
Mid level
Computer Vision • Digital Media • Kids + Family • Mobile • Software • Sports
Operate application security across the SDLC, including secure design, code reviews, threat modeling, API security, DevSecOps tooling, CI/CD security gates, cloud and container security, vulnerability management, and risk communication. Partner with engineering teams on secure coding standards, AWS, Kubernetes, Terraform, mobile ecosystems, and responsible AI integration. Participate in an on-call rotation and develop scalable security platforms, paved roads, documentation, and developer training.
Top Skills: Ai/MlAndroidAWSBugcrowdCdnCi/CdGithub ActionsGithub Advanced Security (Ghas)GraphQLInfrastructure As Code (Iac)iOSKotlinKubernetesNowsecureOwasp Top 10RestSwiftTerraformTypescriptWeb Application Firewall (Waf)Wiz

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account