Pythian Logo

Pythian

Data Architect

Posted One Month Ago
Remote
Hiring Remotely in United States
160K-200K Annually
Senior level
Remote
Hiring Remotely in United States
160K-200K Annually
Senior level
Own end-to-end data platform architecture across ingestion, lakehouse, warehouse, transformation, modeling, governance, and analytics delivery. Build pipelines, Spark and SQL transformations, data models, and production code. Design Databricks or Microsoft Fabric lakehouses, implement Delta Lake and medallion architecture, establish access controls and governance, and integrate databases, SaaS applications, APIs, files, and legacy systems. Evaluate platform choices based on client workloads, licensing, skills, and cost.
The summary above was generated by AI

Why Pythian:


At Pythian, we are experts in strategic database and analytics services, driving digital transformation and operational excellence. Pythian, a multinational company, was founded in 1997 and started by ensuring the reliability and performance of mission-critical databases. We quickly earned a reputation for solving tough data challenges. We were there when the industry moved from on-premises to cloud environments, and as enterprises sought more from their data, we expanded our competencies to include advanced analytics.


Today, we empower organizations to embrace transformation and leverage advanced technologies, including AI, to stay competitive. We deliver innovative solutions that meet each client’s data goals and have built strong partnerships with Google Cloud, AWS, Microsoft, Oracle, SAP, and Snowflake. The powerful combination of our extensive expertise in data and cloud and our ability to keep on top of the latest bleeding edge technologies make us the perfect partner to help mid and large-sized businesses transform to stay ahead in today’s rapidly changing digital economy.


Why you:


We are looking for someone who can design a data platform and then help build it. This is not a whiteboard only role. You will own the architecture, and you will also write pipelines, models, and code alongside the team.


If this is you, and you wonder what it would be like to work at Pythian, reach out to us and find out!  


Intrigued to see what a life is like at Pythian? Check out #pythianlife on LinkedIn and follow @loveyourdata on Instagram!


Not the right job for you? Check out what other great jobs Pythian has open around the world! Pythian Careers


What you will be doing:

  • Own the end to end architecture: ingestion, lakehouse and warehouse layers, transformation, modeling, and delivery to reporting and analytics tools.
  • Build it. Write and deploy pipelines, Spark and SQL transformations, and data models, and review the code the rest of the team writes.
  • Design lakehouse architectures on Databricks or Fabric, including medallion layering, Delta table design, and the semantic layer that sits on top.
  • Make the platform call and defend it. Databricks, Fabric, or a mix, based on the client's workloads, existing licensing, skills, and cost profile.
  • Set up governance and access control using Unity Catalog, Purview, or the equivalent, and apply it consistently rather than bolting it on at the end.
  • Design and build ingestion from a wide range of sources: databases, SaaS applications, APIs, files, and legacy systems that were never meant to be integrated.


What we need from you:

  • Eight or more years in data engineering, with at least three years owning architecture and design decisions.
  • Proven hands on delivery. You should be able to point at platforms you designed and also built.
  • Deep hands on experience with Databricks or Microsoft Fabric, and working knowledge of the other. Comfortable explaining where each one fits and where it does not.
  • Strong Spark and SQL. Solid Python or an equivalent language used in production data work.
  • Experience with Delta Lake, medallion architecture, and lakehouse patterns in production, not just in a demo.
  • Power BI, including how the semantic model is built and where it should live.
  • Solid dimensional and semantic modeling skills. You should have opinions about where business logic belongs and be able to explain why.
  • Working knowledge of data governance: classification, lineage, cataloging, and access control.
  • CI/CD, version control, and testing practices applied to data work, not just to application code.


What sets you apart from other applicants:

  • Azure Government or GCC High delivery experience.
  • Unity Catalog or Purview implementation experience.
  • Azure Data Factory, Synapse, or Azure SQL background.
  • Consulting or client facing delivery experience.
  • Experience in a regulated environment with real compliance constraints.
  • Databricks or Microsoft certifications.


What you will receive:

  • Love your career: Competitive total rewards package. Blog during work hours; take a day off and volunteer for your favorite charity.
  • Love your work/life balance: Flexibly work remotely from your home, there’s no daily travel requirement to an office! All you need is a stable internet connection. 
  • Love your coworkers: Collaborate with some of the best and brightest in the industry!
  • Love your development: Hone your skills or learn new ones with our substantial training allowance; participate in professional development days, attend training, become certified, whatever you like! 
  • Love your workspace: We give you all the equipment you need to work from home including a laptop with your choice of OS, and an annual budget to personalize your work environment!  
  • Love yourself: Pythian cares about the health and well-being of our team. You will have an annual wellness budget to make yourself a priority (use it on gym memberships, massages, fitness and more). Additionally, you will receive a generous amount of paid vacation and sick days, as well as a day off to volunteer for your favorite charity.


Hiring Disclaimer

  • The successful applicant will need to fulfill the requirements necessary to obtain a background check.
  • Accommodations are available upon request for candidates taking part in any aspect of the selection process.


AI Disclaimer

Pythian may utilize Enterprise Generative Artificial Intelligence (AI) tools or features throughout its hiring process. These tools help us manage high volumes of applications efficiently and may be employed to review applications, analyze resumes, and assist with other recruitment steps. While Pythian uses AI in its hiring process, it does not substitute for human judgment. Our Talent Acquisition Team reviews all AI-generated recommendations, and the system is subject to regular bias audits to ensure fairness and compliance with all applicable employment and human rights laws. All final hiring decisions are made by, and remain the responsibility of, human decision-makers. By applying for this position, you consent to Pythian’s use of these AI tools in the evaluation of your application. You have the right to request a human review of any solely AI-driven decision or to request an accommodation. Should you require further details regarding the processing of your data, please reach out to us.

Pythian New York, New York, USA Office

1115 Broadway, New York, NY, United States, 10010

Similar Jobs

2 Days Ago
Remote or Hybrid
New York, NY, USA
120K-140K Annually
Senior level
120K-140K Annually
Senior level
AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
Define and lead the architecture of NBCUniversal’s greenfield Microsoft Fabric enterprise data platform. Establish lakehouse, warehouse, integration, real-time streaming, data modeling, governance, security, DevOps, and observability standards. Translate architecture and business objectives into delivery roadmaps, epics, stories, and implementation plans while guiding multidisciplinary engineering teams. Design scalable solutions combining operational, historical, master, and reference data to support reporting, analytics, automation, AI, and reusable data products.
Top Skills: Amazon KinesisAPIsAzure DevopsAzure Event HubsBicepChange Data CaptureCi/CdData FactoryDelta LakeEventhouseEventstreamGithub ActionsKafkaLakehouseAzureMicrosoft FabricNotebooksOnelakePower BIPysparkPythonReal-Time IntelligenceSemantic ModelsSQLTerraformWarehouse
Yesterday
Remote
US
108K-195K Annually
Senior level
108K-195K Annually
Senior level
Information Technology • Software
Designs and implements enterprise cloud data architectures supporting analytics, geospatial visualization, data integration, migration, governance, and high-performance querying. Develops conceptual, logical, and physical data models, data lakes, data marts, OLAP solutions, reusable SQL metrics, and Gold-layer structures using Azure services and SQL Managed Instance. Advises clients and business leaders, aligns technical decisions with enterprise roadmaps, leads data modernization efforts, and optimizes performance, scalability, and cost.
Top Skills: .NetAgileAWSAzure Analysis ServicesAzure Data LakeAzure DevopsAzure SqlAzure SynapseCi/CdDelta LakeMedallion ArchitectureAzureMicrosoft Sql ServerNoSQLOlapPythonScaled Agile Framework (Safe)SparkSQLSql Managed InstanceSql Server Analysis Services (Ssas)
Yesterday
Remote
USA
84K-106K Annually
Senior level
84K-106K Annually
Senior level
Information Technology • Consulting
Designs and owns Databricks lakehouse architecture, scalable batch and streaming pipelines, data governance, analytics models, and cloud infrastructure. Leads major platform migrations, establishes engineering and CI/CD standards, manages Terraform and FinOps practices, and prototypes AI use cases. The role advises stakeholders, mentors engineers, and ensures secure, compliant, cost-effective data platforms across cloud environments.
Top Skills: Amazon EmrSparkAWSAzureAzure DevopsCi/CdDatabricksDatabricks Asset BundlesFinopsGCPGitGithub ActionsHadoopLangchainLanggraphLlmsMedallion ArchitectureMlflowNoSQLOlapOltpOpenai ApisPysparkPythonScalaSpark SqlSQLTerraformUnity CatalogVector Databases

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account