Virtasant Logo

Virtasant

Senior Databricks Engineer/Architect

Posted 6 Days Ago
In-Office or Remote
Hiring Remotely in Austin, TX
Senior level
In-Office or Remote
Hiring Remotely in Austin, TX
Senior level
Design and maintain scalable data pipelines, lead migrations to Databricks, optimize PySpark transformations, and build reliable ETL/ELT workflows. Ensure data quality, performance, and scalability while translating technical requirements into effective data solutions. Present architecture designs, migration roadmaps, and project outcomes to stakeholders, bridging technical teams and business leadership.
The summary above was generated by AI
Senior Databricks Engineer/Architect

Job Type: 1099 contract, long-term & ongoing

Location: Remote in US

About Virtasant

Virtasant is a global technology services company with a network of over 4,000 technology professionals across 130+ countries.

We help organizations modernize cloud platforms, improve engineering efficiency, and optimize cloud spend through architecture, automation, and FinOps best practices.

Our teams work directly with enterprise customers to identify inefficiencies, drive modernization efforts, and deliver measurable business outcomes.

What We're Looking For

Experienced Senior Data Engineer or Data Architect specializing in designing, developing, and optimizing scalable data pipelines using PySpark and Databricks.

Skilled in architecting and executing data migrations to Databricks, modernizing data platforms, and building robust ETL/ELT workflows that ensure data quality, performance, and reliability.

Adept at translating complex technical requirements into effective data solutions, collaborating with cross-functional teams, and presenting technical strategies, architecture designs, and project outcomes to business stakeholders and leadership.

What You'll Do
  • Design, develop, and maintain scalable, high-performance data pipelines.

  • Architect and lead data migration strategies to the Databricks platform.

  • Develop and optimize complex data transformations using PySpark.

  • Build and enhance ETL/ELT processes to support enterprise data initiatives.

  • Ensure data quality, integrity, scalability, and performance across data platforms.

  • Present technical solutions, migration roadmaps, and project progress to stakeholders.

  • Bridge the gap between technical teams and business stakeholders to align data solutions with organizational objectives.

Similar Jobs

2 Hours Ago
Remote or Hybrid
United States
102K-172K Annually
Expert/Leader
102K-172K Annually
Expert/Leader
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Leads marketing data and analytics strategy, measurement frameworks, dashboards, attribution, journey analytics, experimentation, and AI-enabled decision support. Owns marketing data platform evolution, analytics tools, governance, and KPI development across B2B and B2C initiatives. Manages analytics teams and partners with MarTech, marketing, and product stakeholders to improve acquisition, retention, cross-sell, upsell, and customer experience outcomes.
Top Skills: 6SenseAccuticsAdobe AepAdobe AnalyticsAlteryxCrm PlatformsExcelMedallia DxaPower BIPowerPointPythonSalesforce Data CloudSQLTableau Prep
2 Hours Ago
Remote or Hybrid
United States
85K-125K Annually
Senior level
85K-125K Annually
Senior level
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Manage enterprise email operations across intake, production, quality assurance, deliverability, vendor performance, and process improvement. Oversee templates, personalization, compliance, testing, incident management, and campaign execution. Drive AI-enabled automation, marketing journey operations, vendor governance, and platform optimization. Partner with marketing, technology, compliance, and external vendors to improve scalability, campaign quality, operational efficiency, and performance measurement.
Top Skills: Adobe CampaignAdobe Journey OptimizerCustomer Journey AutomationEmail AutomationGenerative AiMarketing Automation PlatformsSalesforce Marketing Cloud
2 Hours Ago
Remote or Hybrid
United States
102K-151K Annually
Expert/Leader
102K-151K Annually
Expert/Leader
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Own the strategy, roadmap, architecture, delivery, activation, and adoption of Group Benefits marketing data products. Lead cross-functional teams integrating CRM, enrollment, policy, eligibility, digital engagement, and employee data across enterprise platforms. Establish identity resolution, customer hierarchies, consent governance, measurement, attribution, experimentation, and ROI frameworks. Partner with engineering, marketing technology, analytics, and business stakeholders to deliver scalable data solutions supporting personalization, journey orchestration, sales enablement, and AI initiatives.
Top Skills: Adobe CampaignAdobe Experience PlatformAdobe Journey OptimizerAICustomer Data PlatformsDatabricksEtl/EltMachine LearningMarketing AutomationPower BIReal-Time Customer ProfileSalesforceSnowflakeSQLTableauXdm Schemas

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account