Point C Logo

Point C

Databricks Architect

Posted 2 Days Ago
Be an Early Applicant
Remote
Hiring Remotely in United States
100K-120K Annually
Senior level
Remote
Hiring Remotely in United States
100K-120K Annually
Senior level
Designs and builds enterprise-scale Azure lakehouse platforms for claims data using Databricks, Spark, Delta Lake, PySpark, and SQL. Responsibilities include developing Medallion Architecture, ETL/ELT pipelines, data models, governance, access controls, lineage, performance optimization, CI/CD, and production support. The role translates business and data requirements into technical designs while partnering with engineers, analysts, and stakeholders.
The summary above was generated by AI

Point C is a National third-party administrator (TPA) with local market presence that delivers customized self-funded benefit programs. Our commitment and partnership means thinking beyond the typical solutions in the market – to do more for clients – and take them beyond the standard “Point A to Point B.” We have researched the most effective cost containment strategies and are driving down the cost of plans with innovative solutions such as, network and payment integrity, pharmacy benefits and care management. There are many companies with a mission. We are a mission with a company.

We're looking for a Databricks Architect & Developer to design and build enterprise-scale data platforms supporting multiple claims systems. This role will own the end-to-end lakehouse architecture — from ingestion through governance — while partnering closely with data engineers, analysts, and business stakeholders to translate requirements into robust, production-ready technical solutions on Azure.

Primary Responsibilities:

  • Design and implement scalable data platforms using Databricks, Apache Spark, Delta Lake, and SQL, producing solution architecture and technical design documentation.
  • Develop Medallion Architecture (Bronze, Silver, Gold) for enterprise data workloads from multiple claim systems (VBA, Quicklink, HealthPac, and file-based TPAs).
  • Build and optimize production-grade ETL/ELT pipelines using Databricks Workflows, PySpark, and SQL.
  • Work with ADF+ADLS ingest and existing kill-and-fill dimension patterns.
  • Design and maintain data models and Delta tables, implementing schema evolution, time travel, partitioning, and optimization.
  • Design solutions on Azure, integrating cloud storage and databases.
  • Implement Unity Catalog, access controls, data governance, lineage, and security.
  • Translate claim-system data dictionaries into Unity Catalog tables for reporting and APIs.
  • Define and execute performance and cost-optimization strategies across the platform.
  • Work with data engineers, analysts, and business stakeholders to translate requirements into technical designs.
  • Establish CI/CD practices for Databricks notebooks, jobs, and infrastructure.
  • Troubleshoot production data pipelines and support platform reliability.

Qualifications:

Required

  • 5–7 years of data engineering/cloud experience.
  • Strong hands-on experience with Databricks and Apache Spark.
  • Advanced PySpark and SQL.
  • Strong understanding of Delta Lake and Medallion Architecture.
  • Experience with at least one cloud platform: Azure.
  • Knowledge of Data Governance, Unity Catalog, IAM/RBAC, and security.
  • Experience with Git, CI/CD, and infrastructure-as-code concepts.
  • Strong understanding of data warehousing, dimensional modeling, and distributed data processing.

Preferred

  • Azure Data Factory
  • Terraform
  • Kafka or other streaming technologies
  • Power BI platforms
  • Databricks certifications
  • Experience designing enterprise data lakes/lakehouses

Individual compensation will be commensurate with the candidate's experience and qualifications. Certain roles may be eligible for additional compensation, including bonuses, and merit increases. Additionally, certain roles have the opportunity to receive sales commissions that are based on the terms of the sales commission plan applicable to the role.

Pay Transparency
$100,000—$120,000 USD
Benefits:
  • Comprehensive medical, dental, vision, and life insurance coverage
  • 401(k) retirement plan with employer match
  • Health Savings Account (HSA) & Flexible Spending Accounts (FSAs)
  • Paid time off (PTO) and disability leave
  • Employee Assistance Program (EAP)

Equal Employment Opportunity: At Point C Health, we know we are better together. We value, respect, and protect the uniqueness each of us brings. Innovation flourishes by including all voices and makes our business—and our society—stronger. Point C Health is an equal opportunity employer and we are committed to providing equal opportunity in all of our employment practices, including selection, hiring, performance management, promotion, transfer, compensation, benefits, education, training, social, and recreational activities to all persons regardless of race, religious creed, color, national origin, ancestry, physical disability, mental disability, genetic information, pregnancy, marital status, sex, gender, gender identity, gender expression, age, sexual orientation, and military and veteran status, or any other protected status protected by local, state or federal law.


Similar Jobs

11 Days Ago
In-Office or Remote
115K-252K Annually
Expert/Leader
115K-252K Annually
Expert/Leader
Information Technology • Consulting • Defense
Architect and lead implementation of secure Azure Databricks lakehouse platforms using Azure Data Lake Storage, Delta Lake, and Unity Catalog. Design tiered storage, governance, metadata, compute, orchestration, and optimization strategies supporting SQL analytics, data science, graph and geospatial analysis, and machine learning. Modernize analyst workflows, implement MLflow and feature-store infrastructure, develop training and documentation, and collaborate with government, engineering, AI, and governance stakeholders in secure federal environments.
Top Skills: Azure Ai ServicesAzure Data Lake StorageAzure DatabricksDelta LakeGeospatial AnalyticsGraph DatabasesMachine LearningExcelMlflowMlopsPysparkPythonRScalaSQLUnity Catalog
12 Days Ago
Remote
USA
72K-84K Annually
Senior level
72K-84K Annually
Senior level
Information Technology • Consulting
Designs enterprise-scale federated data architectures integrating Palantir Foundry and Databricks. Establishes data-sharing, governance, lineage, metadata, and ownership standards across cloud platforms. Leads legacy ETL modernization, builds scalable PySpark and Spark SQL pipelines, architects secure connectivity, and enables AI, machine learning, real-time analytics, and self-service data products. Serves as the technical authority, leads architecture reviews, and manages stakeholder relationships.
Top Skills: Apache AirflowApache IcebergBigQueryCatalog FederationCi/CdCloud StorageDatabricksDatabricks WorkflowsDelta LakeFoundry OntologyGithub ActionsGoogle Cloud PlatformIamKubernetesPalantir FoundryPub/SubPysparkPythonSpark SqlTerraformUnity CatalogVirtual Tables
19 Days Ago
Remote
USA
Senior level
Senior level
Pet
Provides strategic architecture leadership for an enterprise Databricks data modernization program. Defines target-state data and analytics architectures, migration strategies, governance frameworks, security standards, and implementation roadmaps. Guides engineering teams on scalability, performance, cost optimization, integration, and AI/ML enablement while aligning technology investments with business and regulatory requirements. Engages executives, stakeholders, and vendors; oversees solution quality, mitigates technical risks, and mentors teams.
Top Skills: Ai/MlAzure Data FactoryAzure Data ServicesAzure Synapse AnalyticsData LakehouseDatabricksDataopsDelta LakeDevOpsAzureSQL ServerUnity Catalog

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account