Tiger Analytics Logo

Tiger Analytics

Databricks Architect

Reposted 2 Months Ago
Be an Early Applicant
Remote
Hiring Remotely in United States
Expert/Leader
Remote
Hiring Remotely in United States
Expert/Leader
The Databricks Architect will design and implement large-scale data solutions, optimizing performance and reliability, while leading initiatives in data engineering.
The summary above was generated by AI

Tiger Analytics is pioneering what AI and analytics can do to solve some of the toughest problems faced by organizations globally. We develop bespoke solutions powered by data and technology for several Fortune 100 companies. We have offices in multiple cities across the US, UK, India, and Singapore, and a substantial remote global workforce.

If you have a passion for tackling business challenges through the use of both structured and unstructured data at scale, Tiger Analytics wants to connect with you. We are looking for a skilled and proactive Databricks Architect to take a pivotal role in designing and deploying resilient data solutions that address our clients' complex business issues.
Responsibilities

  • Design and implement scalable, end-to-end data solutions for ETL, real-time streaming, and machine learning workloads on the Databricks platform
  • Provide technical leadership and strategic guidance on Databricks adoption, including developing reference architectures and best practices.
  • Ensure optimal performance by tuning Spark jobs, optimizing data pipelines, and resolving complex technical issues.
  • Architect, develop, and debug PySpark jobs and data models, integrating Databricks with cloud services such as AWS S3, EMR, and Lambda
  • Implement and enforce data governance, security, and access control policies (e.g., encryption, auditing) on the Databricks environment

Requirements
  • 12+ years of experience in Architecture, design and data engineering development of large-scale data ecosystems.
  • Databricks Design and Architecture: Design and architect scalable and secure Databricks solutions platform, optimizing performance, cost, and reliability.
  • Hands on Databricks/Dataops Architect that can help reduce consumption, and improve performance issues. Can help build monitoring tools.
  • Good exposure to AWS. Strong comm and leadership skills and Self driven and work independently.
  • Experience in Performance initiatives and drive recommendations (identify tuning opportunities, creation of performance environment etc.
  • Experience with hadoop environment.
  • Core Skills:- Databricks platform knowledge, Unity Catalog migration implementation exposure, Spark Streaming pipeline design exposure

Benefits

Significant career development opportunities exist as the company grows. The position offers a unique opportunity to be part of a small, fast-growing, challenging, and entrepreneurial environment, with a high degree of individual responsibility.
Tiger Analytics provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity/expression, pregnancy,
national origin, ancestry, marital status, protected veteran status, disability
status, or any other basis as protected by federal, state, or local law.

Similar Jobs

6 Days Ago
In-Office or Remote
Senior level
Senior level
Information Technology • Consulting
Design and maintain scalable data pipelines, lead migrations to Databricks, optimize PySpark transformations, and build reliable ETL/ELT workflows. Ensure data quality, performance, and scalability while translating technical requirements into effective data solutions. Present architecture designs, migration roadmaps, and project outcomes to stakeholders, bridging technical teams and business leadership.
Top Skills: DatabricksEtl/EltPyspark
6 Days Ago
Remote
United States
Senior level
Senior level
Artificial Intelligence • Information Technology • Machine Learning • Generative AI • Big Data Analytics
Own enterprise Databricks Lakehouse target architectures, including ingestion, storage, transformation, serving, governance, cost, and performance. Lead legacy platform assessments and migration strategies, establish data modeling and Unity Catalog standards, guide technical estimates and pre-sales discovery, mentor engineers, review designs, and create reusable architecture assets. The role requires extensive data architecture experience, cloud migration expertise, Python, SQL, Spark, CI/CD, and customer-facing technical leadership.
Top Skills: SparkAsset BundlesCi/CdDatabricksDelta LakeDevOpsHadoopInformaticaLakeflowMlopsNetezzaPythonSQLTeradataUnity Catalog
One Month Ago
Remote
USA
130K-216K Annually
Senior level
130K-216K Annually
Senior level
Consulting
Design and implement enterprise Databricks architectures supporting data engineering, analytics, AI/ML, and governed data products. Administer workspaces, Unity Catalog, compute, security, automation, and platform operations. Translate business and security requirements into technical designs, governance standards, deployment patterns, and operational playbooks. Partner with cloud, cybersecurity, identity, networking, and DevOps teams across Azure, AWS, and GCP. Lead architecture reviews, troubleshoot platform issues, advise clients, and support secure, scalable production deployments.
Top Skills: Ai GatewaySparkAPIsAWSAzureCi/CdDatabricksDatabricks AppsDatabricks Asset BundlesDelta TablesGCPGenie OneGitMlflowPythonReactSQLTerraformUnity Catalog

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account