v4c.ai Logo

v4c.ai

Databricks QA Engineer (Remote, US)

Posted 7 Days Ago
Remote
Hiring Remotely in United States
70-80 Hourly
Senior level
Remote
Hiring Remotely in United States
70-80 Hourly
Senior level
Own quality strategy and release sign-off for enterprise Databricks data platforms. Build Python and PySpark test suites with pytest, validate ingestion and Medallion transformations, implement data quality rules, test Delta Lake and ELT workflows, and maintain CI quality gates that block failed releases. Partner with data engineers and customers to improve automation coverage and prevent production data errors.
The summary above was generated by AI
About V4C.ai

V4C is a pure-play Databricks partner, and in under two years we have earned 850+ Databricks certifications across 325+ customers and been named Databricks' 2026 Partner of the Year (C&SI Emerging).

As a Databricks QA Engineer on our data engineering team you will own the quality gate for enterprise data platforms, working directly with customers. You will work on live enterprise data platforms alongside one of the most heavily Databricks-certified delivery teams in the market.

The Role

This is a QA role for people who understand data engineering, not general software QA pointed at a data project. You will validate Lakehouse pipelines, which means reasoning about row counts, schema drift, late-arriving data, and silent transformation errors no UI will ever surface. Our approach is automation-first: suites in Python and PySpark, running in CI, blocking promotion when they fail. You own release sign-off, which makes you the last person between a customer and bad data in production. 

Responsibilities

  • Own test strategy and release sign-off on engagements, including documented test plans covering scope, risk, and coverage
  • Build and maintain automated test suites in Python and PySpark (pytest), integrated into CI pipelines
  • Validate data pipelines end to end: ingestion, Medallion layer transformations, Delta Lake tables, and ELT workflows
  • Implement data quality rules as code, including Lakeflow expectations and reusable validation frameworks
  • Run regression validation after code changes and maintain CI quality gates that block merge or promotion on failure
  • Partner with engineers to identify automation candidates and raise the coverage bar across the practice

Requirements
  • 5+ years in QA automation or test engineering, including meaningful time testing data pipelines rather than applications alone
  • A data engineering background: you can read a pipeline, reason about a transformation, and write the SQL to verify it
  • Expert-level SQL
  • Experience with Medallion architecture, Delta Lake, and ELT-based data platforms
  • Experience building automated suites that run in CI and gate deployment
  • Demonstrable hands-on experience working on Databricks or similar platforms

Preferences

  • Healthcare or life sciences experience preferred but not required
  • Existing Databricks certification(s)
  • Hands-on experience with Unity Catalog, Lakeflow pipelines, or Databricks Asset Bundles
  • Experience with Azure DevOps pipelines, or equivalent CI tooling (GitHub Actions, GitLab CI)
  • Familiarity with contract-based data validation standards such as ODCS
  • Experience using LLM agents or MCP-connected tooling to run validations, triage failures, or draft defect reports
  • Consulting or client-facing background

Benefits

Pay Rate: $70 – $80 per hour (1099 independent contractor).

This is a contract engagement rather than a salaried employee role. Where a rate lands within the range depends on depth of data-pipeline testing experience and automation capability. Open to contractors anywhere in the United States.

Similar Jobs

An Hour Ago
Remote or Hybrid
California, USA
Senior level
Senior level
Consumer Web • eCommerce • Information Technology • Retail • Software • Analytics • App development
Leads state and local government affairs across Western markets, including policy monitoring, legislative analysis, advocacy strategy, lobbying, stakeholder engagement, and relationships with elected officials, trade associations, NGOs, and community groups. Partners with internal business functions to align public policy initiatives with enterprise priorities, directs lobbyists and consultants, and serves as a subject matter lead on retail policy issues. The role is based in Sacramento and requires travel up to 40%.
An Hour Ago
Remote or Hybrid
United States
71K-120K Annually
Mid level
71K-120K Annually
Mid level
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Analyzes operational data across payments, fraud, customer service, compliance, and processing to identify trends, anomalies, risks, control gaps, and process breakdowns. Develops predictive monitoring models, dashboards, and exception reports; leads root cause analysis; recommends corrective actions; and helps standardize control reporting for operations and leadership.
Top Skills: Power BIPython
An Hour Ago
Remote or Hybrid
United States
59K-99K Annually
Mid level
59K-99K Annually
Mid level
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Analyzes fraud cases, reviews documentation and account activity, makes audit-ready determinations, monitors fraud and operational risk trends, and develops control reporting. The role identifies control gaps, supports remediation, strengthens fraud oversight and governance, and partners with operations, risk, compliance, privacy, and investigations teams to improve mitigation processes.

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account