Sonoma Consulting Inc. Logo

Sonoma Consulting Inc.

Big Data/Hadoop Developer

Posted An Hour Ago
Be an Early Applicant
In-Office
New York, NY, USA
Mid level
In-Office
New York, NY, USA
Mid level
Develop, debug, and optimize Hadoop-based data solutions using Pig, Hive, Sqoop, HBase and Java. Write and maintain shell/Python scripts, perform performance tuning, apply Big Data architecture/design patterns, guide the Hadoop team, coordinate with application teams for issue resolution, and provide on-call weekend support.
The summary above was generated by AI
Company Description

Halo Group is a premier provider of IT talent. We place technology experts within
the teams of the world’s leading companies to help them build innovative
businesses that keep them one step closer to their customers and one step
ahead of the competition. We offer a meaningful work environment for
employees, attractive and interesting engagements for consultants, and cutting-edge
digital innovation for our customers.
We delight in helping our customers execute their digital vision. Big projects or
small, Halo Group knows that by combining the highest quality talent with our
unwavering support, we will become an invaluable extension of the team. Halo
Group's experienced consultants in Detroit, Atlanta and Dallas specialize in all
areas of product/project governance, UX/UI, multi-platform applications, quality
assurance/testing, cloud computing, and data analytics.
Since its inception, Halo Group has been recognized for numerous awards, including: 
- INC 5000
- Future 50
- 101 Best and Brightest
- Michigan 50 Companies to Watch
- Goldline Research - “Most Dependable Companies”
- Ernst & Young - “Entrepreneur of the Year” Finalist

Job Description

Mandatory Skills:

• Hands on experience in BigData space (Hadoop Stack like HDFS, Pig, Hive, HBase, Sqoop etc)

Experience with Java programming

Provide oversight and guidance to Hadoop team

Ability to debug & write / modify Pig. Hive, Sqoop codes

Ability to debug & write / modify Shell script/Python

Very good understanding of Big Data eco-system

Candidate should also have good knowledge of Big Data architecture patterns, design patterns, estimation techniques, performance tuning and trouble shooting

Willing to work on-call support over weekends

Liase with multiple application teams & co-ordinate for issue resolution

Good analytical & interaction skills

Qualifications

• Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.

• At least 4 years of experience with IT

Additional Information

All your information will be kept confidential according to EEO guidelines.

Similar Jobs

An Hour Ago
In-Office
New York, NY, USA
Senior level
Senior level
Information Technology • Professional Services • Consulting
Design, develop, debug and tune Hadoop-based ETL using HDFS, Pig, Hive, HBase, Sqoop and Java. Provide technical oversight to the Hadoop team, write/modify shell or Python scripts, liaise with application teams, perform performance tuning and troubleshooting, and provide on-call weekend support.
Top Skills: HadoopHbaseHdfsHiveJavaPigPythonShellSqoop
4 Hours Ago
In-Office
100K-150K Annually
Senior level
100K-150K Annually
Senior level
Artificial Intelligence • Information Technology • Software • Consulting
Design, build, and operate large-scale Hadoop-based data pipelines and streaming systems. Implement ETL/ELT workflows, optimize Spark/MapReduce jobs, manage data storage and lakehouse formats, enforce data governance and monitoring, automate orchestration, and mentor engineers to deliver reliable, production-grade analytics platforms.
Top Skills: AirflowApache AtlasSparkAws EmrBigQueryCi/CdCollibraDatabricksDeltaFlinkHadoopHbaseHdfsHiveHudiIcebergInfrastructure-As-CodeJavaKafkaKubernetesMapreduceNoSQLOozieOrcParquetPigPythonScalaShellSnowflakeSpark StreamingSQLSqoopTrino
15 Minutes Ago
Remote or Hybrid
United States
144K-243K Annually
Expert/Leader
144K-243K Annually
Expert/Leader
Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
Lead SailPoint Professional Services partner delivery strategy and team operations for IdentityNow SaaS. Own engagement scoping, resource allocation, profitability, partner enablement, escalations, and cross-functional coordination with Sales, Customer Success, and Enablement to drive service delivery and revenue growth.
Top Skills: .NetActive DirectoryApplication ServersC++HTMLIdentitynowJavaLdapMssqlMySQLOraclePeoplesoftSAPSoapSpmlSybaseWeb ServersXML

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account