Designs, deploys, governs, and supports enterprise Databricks platforms across AWS Commercial and GovCloud environments. Responsibilities include Terraform-based workspace deployment, AWS networking, Unity Catalog administration, CI/CD automation, security and governance controls, platform monitoring, cost optimization, incident escalation, and stakeholder guidance. Requires extensive Databricks administration, AWS infrastructure, infrastructure-as-code, Python, Linux, and federal security environment experience.
This is a remote position.
Location: Remote – United States
Security Clearance: Active Secret or higher REQUIRED
Our client, a growing technology services organization supporting federal government programs, is seeking an experienced Senior Databricks Platform Engineer / Administrator to help design, deploy, govern, and support enterprise Databricks environments for a federal client.
Candidates must currently hold an ACTIVE Secret security clearance or higher. Candidates without an active Secret-level clearance cannot be considered.
The ideal candidate will bring deep hands-on experience building and administering Databricks platforms, particularly within AWS environments, with strong expertise in infrastructure automation, networking, governance, security, CI/CD, and platform operations.
- Deploy and configure Databricks workspaces from the ground up using Terraform and Databricks Secure Reference Architecture across development, test, and production environments.
- Support Databricks deployments within AWS Commercial and AWS GovCloud environments.
- Design and implement supporting AWS networking architecture, including VPCs, subnets, PrivateLink, Transit Gateway, security groups, and DNS.
- Manage Databricks control-plane and data-plane connectivity.
- Administer Unity Catalog, including metastores, catalogs, schemas, external locations, permissions, grants, and row- and column-level security.
- Build and maintain CI/CD pipelines supporting infrastructure deployment and Databricks Asset Bundles.
- Establish platform governance standards, architectural guardrails, tagging strategies, naming conventions, and operating best practices.
- Automate provisioning and administration of cluster policies, secrets, service principals, SSO, and SCIM integrations.
- Monitor platform health, utilization, performance, and cost.
- Identify opportunities for rightsizing, cost optimization, and improved platform efficiency.
- Serve as an escalation point for platform incidents, troubleshooting, and root-cause analysis.
- Partner with technical and business stakeholders to provide guidance on platform architecture, governance, security, and operational decisions.
Requirements
- Active Secret security clearance or higher is required.
- U.S. citizenship required.
- 6+ years of experience engineering, administering, or supporting Databricks platforms.
- Strong hands-on experience with Databricks in AWS environments.
- Advanced Terraform experience supporting infrastructure such as networking, IAM, compute, and storage.
- Strong knowledge of Databricks Secure Reference Architecture.
- Hands-on Unity Catalog administration experience.
- Experience with Databricks Asset Bundles or comparable deployment automation frameworks.
- Strong understanding of CI/CD practices and infrastructure-as-code methodologies.
- Python proficiency.
- Linux systems administration experience.
- Hands-on experience with AWS services including:
- VPC
- IAM
- S3
- KMS
- EC2
- CloudWatch
- VPC
- Strong troubleshooting and root-cause analysis capabilities.
- Strong communication skills with the ability to advise stakeholders on technical and platform decisions.
- AWS GovCloud experience.
- Experience working within regulated, security-sensitive, or compliance-heavy environments.
- Experience supporting FISMA High, FedRAMP High, or comparable federal security standards.
- Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field.
Similar Jobs
.png)
An Hour Ago
Healthtech • Social Impact • Telehealth
Provide evidence-based psychotherapy to older adults through telehealth. Responsibilities include developing personalized treatment plans, documenting care in an EMR with AI assistance, working independently within a collaborative care team, and participating in paid case consultations. The role requires an independently licensed therapist in Tennessee with a relevant graduate degree and offers flexible scheduling, remote work, clinical support, and part-time or full-time opportunities.
Top Skills:
Ai Documentation ToolsElectronic Health Records (Ehr)EmrTelehealth Platforms
An Hour Ago
Healthtech • Social Impact • Telehealth
Deliver evidence-based psychotherapy to older adults through virtual care. Responsibilities include developing personalized treatment plans, documenting care in an EMR with AI assistance, collaborating with clinical support teams, and participating in paid case consultations. The role requires an independently licensed therapist in Maryland with a relevant graduate degree and offers flexible part-time or full-time remote scheduling.
Top Skills:
Ai Documentation ToolsElectronic Health Records (Emr)Telehealth Platforms
An Hour Ago
Healthtech • Social Impact • Telehealth
Provide evidence-based psychotherapy to older adults through telehealth. Develop personalized treatment plans, maintain clinical documentation using EMR and AI tools, work independently within a collaborative care team, and participate in paid case consultations. The role requires an independently licensed clinician in Washington with a relevant graduate degree and offers flexible part-time or full-time remote work.
Top Skills:
Ai Documentation ToolsElectronic Health Records (Ehr)EmrTelehealth Platforms
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
