Designs and optimizes Databricks data pipelines, Spark jobs, clusters, data models, ETL/ELT processes, and Lakehouse architectures. Implements governance, security controls, CI/CD, and cloud integrations across AWS, Azure, and GCP. Advises engineering teams, mentors staff, defines technical roadmaps, collaborates with stakeholders, and troubleshoots Databricks performance and system issues.
True Zero Technologies, a veteran-owned small business, was founded on the principle that the purposeful enablement of people and technology in an organization directly ties to the quality of its outcomes. True Zero recognizes that those outcomes begin and end with our people, and that is what we have built a community of like-minded, driven, and passionate individuals and innovators who are aligned in a common goal of delivering top-tier services to our customers. Our culture and commitment have been recognized through numerous accolades, including being named one of the Best Places to Work in 2023 in two categories (“Prosperous and Thriving” ($5MM–$50MM in gross revenue) and “Mid-Atlantic Region” (DC, DE, MD, NC, VA, WV)), and again in 2025 as a Best Places to Work honoree. In addition, True Zero earned coveted spots on the Inc. 5000 list of fastest-growing companies in America in 2022, 2023, and 2025, a testament to our sustained growth driven by our people-first approach and unwavering dedication to excellence.
Position Responsibilities
- Performance & Optimization: Optimize data pipelines, configure clusters, and implement best practices for cost and performance.
- Governance & Security: Implement security protocols, such as Unity Catalog, IAM, and data access controls.
- Technical Leadership: Act as a trusted advisor to engineering teams, mentor staff, and define technical roadmaps.
- Collaboration: Work with data engineers and stakeholders to align technical solutions with business requirements.
- Technical Expertise: Strong proficiency in Databricks, Apache Spark, Python/PySpark, and SQL.
- Cloud Proficiency: Experience with cloud platforms, specifically AWS (S3, Glue) or Azure.
- Data Modeling: Expertise in data modeling, data profiling, and ETL/ELT pipeline design
- Architecture & Development: Design and implement scalable data pipelines, data models, and Lakehouse architectures.
- Implement CI/CD pipelines, use tools like Azure DevOps or Git for version control, and automate routine tasks.
- Integrate data from various cloud sources and services (AWS, Azure, GCP) such as Blob Storage, Data Lake Storage, and other databases.
- Optimize Spark jobs & monitor system metrics to quickly troubleshoot issues related to the Databricks environment.
Position Qualifications
- Requires 3-5 years of experience in data engineering, data warehousing, or data architecture roles.
- US citizenship and ability to obtain and maintain a federal security clearance may be required
- Bachelors degree is highly preferred
Similar Jobs
Information Technology • Cybersecurity
Owns end-to-end B2B livestream and video programming, including concepts, research, scripting, casting, directing, production, post-production, and content repurposing. The role develops compelling narratives for product and thought-leadership streams, coaches executives and subject-matter experts on camera, creates repeatable production systems, coordinates promotion with marketing teams, and uses AI tools to improve scripting, editing, research, and production workflows.
Top Skills:
Adobe SuiteAi Tools
HR Tech • Information Technology • Professional Services • Sales • Software
Lead the vision, strategy, roadmap, and growth of HiBob’s new AI-native FP&A product line. Build and manage a product management team, partner with engineering on calculation engines, data models, integrations, and AI architecture, and collaborate with go-to-market teams on positioning, pricing, packaging, launch, and adoption. The role requires deep FP&A or EPM domain expertise, strong technical and executive communication skills, and hands-on product leadership from concept through market success.
Top Skills:
Agentic AiAIB2B SaasCalculation EnginesData IntegrationsEpmFp&A SoftwareUnified Data Models
HR Tech • Information Technology • Professional Services • Sales • Software
Own a core area of HiBob’s AI-native FP&A product, from discovery through launch and adoption. Define planning, modeling, drivers, formulas, scenarios, data models, integrations, and agent experiences. Partner with engineering on technical architecture, design on planning interfaces, and finance users on validation. Translate customer and market insights into priorities while connecting FP&A capabilities with HiBob’s HR and finance products.
Top Skills:
Agent FrameworksAIB2B SaasData PlatformsErp IntegrationsFigmaGenerative AiLlm ToolingMcpUnified Data Models
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
