Design and implement data integration and data warehouse solutions using big data technologies. Build cost-efficient, performant cloud data pipelines, apply data modeling and machine learning knowledge, and implement real-time streaming and aggregation patterns.
Role Big Data Engineer Responsibilities Implement Data integration and Data Warehouse based solutions using Big Data Technologies. Should be highly proficient in the use of Big Data / Open Source Technologies and standard techniques of Data Integration, Data Manipulation with hands-on contribution. Should be able to develop cost efficient and performant data pipelines in the cloud platform In-depth understanding of modern big data technology, including Data modeling and machine learning skills Knowledge of real time data streaming and aggregation architectural patterns and practice Essential Skills: 3+ Years hands on knowledge on SQL as well as SQL/NoSQL databases Proficient in programming languages such as Python and PySpark/Scala/Java
Hexaware Technologies Iselin, New Jersey, USA Office
101 Wood Avenue South Suite, Iselin, United States, 08830
Hexaware Technologies Jamesburg, New Jersey, USA Office
1095 Cranbury S Rvr Rd St, Jamesburg, New Jersey, 08831-3411, United States, Jamesburg, United States, 08831-3411
Hexaware Technologies Jersey City, New Jersey, USA Office
Jersey City, United States
Hexaware Technologies New York, New York, USA Office
New York, United States, 0
Hexaware Technologies Secaucus, New Jersey, USA Office
Secaucus, United States
Similar Jobs
Automotive • Big Data • Insurance • Software • Transportation
Designs, builds, and maintains scalable ETL/ELT pipelines and finance data models using Snowflake, AWS, dbt Core, Python, and SQL. Develops Medallion architecture data marts, integrates ERP systems, and partners with stakeholders on financial workflows. Implements data governance, RBAC, automated quality testing, observability, documentation, CI/CD, and secure deployments. Monitors Snowflake costs and optimizes queries while supporting Oracle EBS integrations and the migration to Workday.
Top Skills:
AWSCi/CdDbt CoreGitOracle EbsPythonSnowflakeSQLWorkday
Information Technology • Consulting
Build and maintain ETL and data pipelines using Python, PySpark, and AWS services. Orchestrate workflows, develop event-driven integrations, optimize data storage and queries, process API and JSON data, and implement data quality monitoring. Support CI/CD, production operations, cloud migration, data lake and lakehouse initiatives, and near-real-time systems while collaborating with stakeholders to deliver technical solutions.
Top Skills:
Amazon AthenaAmazon CloudwatchAmazon DynamodbAmazon EmrAmazon KinesisAmazon RdsAmazon RedshiftAmazon S3Amazon SnsAmazon SqsApache AirflowAPIsAws GlueAws LambdaAws Step FunctionsCi/CdData LakesData WarehousingGithub CopilotGitlabJSONLakehouseMcpOraclePysparkPythonSQLTerraform
Social Media
Lead Pinterest’s technical strategy and roadmap for scalable big data and AI infrastructure. Build frameworks for compute, job, resource, scheduling, and shuffle management across petabyte-scale datasets. Partner with internal customers, provide company-wide technical leadership, and improve data processing reliability, speed, and efficiency.
Top Skills:
AWSFlinkGoJavaKubernetesPythonPyTorchRayScalaSparkTensorFlow
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
