Hexaware Technologies Logo

Hexaware Technologies

Big Data Lead

Reposted 3 Months Ago
Be an Early Applicant
Remote
Hiring Remotely in United States
Mid level
Remote
Hiring Remotely in United States
Mid level
Lead the development of data pipelines and transformations in Azure Databricks, converting Scala programs to PySpark while leveraging various Azure technologies.
The summary above was generated by AI
Job Description :

Location - US (remote) . East coast preferable
Primary Skill :
       Technical Lead -Data Engneering
 

  •  Azure databricks- Build Data Pipelines using ADB-Leveraging Python and Spark
  •   Build Data Transformation in ADB
  •   Convert Scala Pgms to Py Spark Pgms
  •   Understand  the SCALA program in DataBricks
  •   ADF
  • Secondary Skills:
  •   Azure data lake gen 2
  •   Synapse analytics (dedicated SQL pool)
  •    Exp in delta Lake
  •     Pyspark

Nice to Have : Tidal Scheduler , Exp in Healthcare Domain

Hexaware Technologies Iselin, New Jersey, USA Office

101 Wood Avenue South Suite, Iselin, United States, 08830

Hexaware Technologies Jamesburg, New Jersey, USA Office

1095 Cranbury S Rvr Rd St, Jamesburg, New Jersey, 08831-3411, United States, Jamesburg, United States, 08831-3411

Hexaware Technologies Jersey City, New Jersey, USA Office

Jersey City, United States

Hexaware Technologies New York, New York, USA Office

New York, United States, 0

Hexaware Technologies Secaucus, New Jersey, USA Office

Secaucus, United States

Similar Jobs

7 Days Ago
Remote
United States
Entry level
Entry level
Information Technology • Consulting
Design and maintain conceptual, logical, and physical data models for scalable data architectures. Implement Data Vault structures, including Hubs, Links, and Satellites, across enterprise data lakes and lakehouses. Deploy models using Azure data services, optimize performance, document data flows, and collaborate with engineers, scientists, analysts, and stakeholders. Apply data modeling best practices, integration techniques, security standards, and compliance requirements.
Top Skills: AzureAzure Data LakeAzure Sql DatabaseAzure Synapse AnalyticsData VaultDatabricksEr/StudioErwinPower Designer
14 Days Ago
In-Office or Remote
Senior level
Senior level
Information Technology • Software • Analytics • Business Intelligence
Leads teams developing and maintaining complex cloud-based big data platforms and pipelines. Owns architecture, delivery strategy, data modeling, governance, observability, reliability, security, and cost optimization. Translates business requirements into technical plans, oversees coding and production support, manages risks and client communication, establishes quality and CI/CD practices, and mentors engineers while providing cross-team architectural governance.
Top Skills: AlertingCi/CdCloud ComputingData CatalogingData GovernanceData LineageData ModelingEvent-Driven PipelinesGCPGitKappa ArchitectureLambda ArchitectureLoggingMicroservicesMonitoringObservabilityPythonScrumSQL
One Month Ago
Remote
United States
Entry level
Entry level
Information Technology • Consulting
Leads hands-on big data processing, data engineering, and analytics workflows using Azure Databricks, Python, and SQL. Develops insights and reporting with Power BI, Tableau, and Excel. Analyzes complex datasets, communicates findings to business stakeholders, manages competing priorities, meets deadlines, and promotes continuous improvement.
Top Skills: Azure DatabricksExcelPower BIPythonSQLTableau

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account