Hexaware Technologies Logo

Hexaware Technologies

Big Data Engineer

Posted 2 Days Ago
Remote
Hiring Remotely in United States
Senior level
Remote
Hiring Remotely in United States
Senior level
Build and maintain ETL and data pipelines using Python, PySpark, and AWS services. Orchestrate workflows, develop event-driven integrations, optimize data storage and queries, process API and JSON data, and implement data quality monitoring. Support CI/CD, production operations, cloud migration, data lake and lakehouse initiatives, and near-real-time systems while collaborating with stakeholders to deliver technical solutions.
The summary above was generated by AI

Build and maintain ETL pipelines using Python and PySpark on AWS Glue and related platforms. 

Orchestrate workflows using AWS Step Functions and Lambda. - Implement messaging and event-driven integrations using SNS and SQS. Design and optimize storage and querying solutions in Amazon Redshift, RDS, Oracle and S3-based architectures. 

Write efficient SQL for transformations, validation, and reporting. - Integrate data from APIs and process structured and semi-structured JSON data. - Implement data quality checks, monitoring, and operational support processes. 

Participate in CI/CD and version control practices for deployment and release management. 

Collaborate with cross-functional teams to translate business requirements into technical solutions. 

8 years of software development experience across the appropriate platform. 

Strong hands-on experience with Python, PySpark, API’s and SQL. 

Experience with ETL/data pipeline development and Orchestration using Step functions / AirFlow .

 Working knowledge of AWS services including Glue, Lambda, Step Functions, Redshift, S3, SNS, and SQS. 

Experience with Athena, EMR, Kinesis, DynamoDB, or RDS. - Good Knowledge on CloudWatch, logging, and production support. 

Understanding of data warehousing, data lakes, Lake House and query optimization. 

Experience with GitLab/Terraform or similar and CI/CD workflows. 

Good understanding of using AI tools like Github Copilot or similar for code productivity .

Exposure to enterprise data lake or cloud migration initiatives. 

Have an eye to solving complex problems, great communication with stakeholders .

Have a good understanding of performance engineering of code pipelines and near real time systems - Good understanding on Agents and MCP".

A Bachelor’s Degree in Information Technology, Computer Science, Business Administration, or a related field is required.

Hexaware Technologies Iselin, New Jersey, USA Office

101 Wood Avenue South Suite, Iselin, United States, 08830

Hexaware Technologies Jamesburg, New Jersey, USA Office

1095 Cranbury S Rvr Rd St, Jamesburg, New Jersey, 08831-3411, United States, Jamesburg, United States, 08831-3411

Hexaware Technologies Jersey City, New Jersey, USA Office

Jersey City, United States

Hexaware Technologies New York, New York, USA Office

New York, United States, 0

Hexaware Technologies Secaucus, New Jersey, USA Office

Secaucus, United States

Similar Jobs

9 Days Ago
Easy Apply
Remote or Hybrid
14 Locations
Easy Apply
120K-150K Annually
Mid level
120K-150K Annually
Mid level
Automotive • Big Data • Insurance • Software • Transportation
Designs, builds, and maintains scalable ETL/ELT pipelines and finance data models using Snowflake, AWS, dbt Core, Python, and SQL. Develops Medallion architecture data marts, integrates ERP systems, and partners with stakeholders on financial workflows. Implements data governance, RBAC, automated quality testing, observability, documentation, CI/CD, and secure deployments. Monitors Snowflake costs and optimizes queries while supporting Oracle EBS integrations and the migration to Workday.
Top Skills: AWSCi/CdDbt CoreGitOracle EbsPythonSnowflakeSQLWorkday
8 Days Ago
In-Office or Remote
243K-500K Annually
Expert/Leader
243K-500K Annually
Expert/Leader
Social Media
Lead Pinterest’s technical strategy and roadmap for scalable big data and AI infrastructure. Build frameworks for compute, job, resource, scheduling, and shuffle management across petabyte-scale datasets. Partner with internal customers, provide company-wide technical leadership, and improve data processing reliability, speed, and efficiency.
Top Skills: AWSFlinkGoJavaKubernetesPythonPyTorchRayScalaSparkTensorFlow
One Month Ago
Remote
United States
Mid level
Mid level
Information Technology • Consulting
Design and implement data integration and data warehouse solutions using big data technologies. Build cost-efficient, performant cloud data pipelines, apply data modeling and machine learning knowledge, and implement real-time streaming and aggregation patterns.
Top Skills: CloudData WarehouseJavaMachine LearningNoSQLPysparkPythonReal-Time StreamingScalaSQL

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account