Design, build, and support a data lake: manage ingestion, data management, and client consumption. Implement Big Data platforms (HDFS, YARN), optimize Hive (partitioning, reducer/block sizing), develop Spark jobs (Python/Scala), work with ETL tools (Informatica) and NoSQL (Cassandra, Drill, Impala) in AWS. Meet deadlines, handle multiple tasks, and communicate with stakeholders.
Company Description
SonSoft is an IT Staffing and consulting firm and duly organized under the laws of the Commonwealth of Georgia. We are growing at a steady pace specializing in the fields of Software Development, Software Consultancy and Information Technology Enabled Services.
- The Data Lake engineer should come from the background of a Big Data Architect. The position will be in support of data management, ingestion, and client consumption. This individual has an absolute requirement to be well versed in Big Data fundamentals such as HDFS and YARN. More than a working knowledge of Hive is required with understanding of partitioning/reducer size/block sizing/etc.
- Preferably, the candidate has a strong knowledge of Spark on either Python or Scala.
- Good Spark knowledge is required.
- Knowledge of other industry ETL tools (including No SQL) such Cassandra/Drill/Impala/etc. is a plus.
- They should of 1 year exp. in these technologies implemented in cloud (AWS).So they should have the associated cloud experience in AWS.
- Ability to meet deadlines and handle multiple tasks, decisive with strong leadership qualities, flexible in work schedules and possess good communication skills.
- Skills/Qualifications: BE, BTech, MCA, Worked on Informatica PowerCenter, and other informatica products. Should have Strong Analytical and interpersonal skills with good written and verbal communication
** U.S. citizens and those authorized to work in the U.S. are encouraged to apply. We are unable to sponsor at this time.
Note:-
- This is a Full-Time Permanent job opportunity for you.
- Only US Citizen, Green Card Holdercan apply.
- No , , H4-EAD & L2-EADTN Visa, GC-EAD OPT-EAD & H1B Consultants please.
- Please mention your Visa Status in your email or resume.
Similar Jobs
Information Technology • Professional Services • Software • Consulting
Design and implement data lake ingestion and client consumption solutions. Work with Hadoop (HDFS, YARN), optimize Hive, build Spark jobs (Python/Scala), use Informatica PowerCenter, and deploy/operate solutions on AWS while meeting deadlines and leading tasks.
Top Skills:
AWSCassandraDrillHdfsHiveImpalaInformaticaInformatica PowercenterNoSQLPythonScalaSparkYarn
Information Technology • Professional Services • Software • Consulting
Design, build, and support data lake/data management, ingestion, and client consumption. Require strong Big Data fundamentals (HDFS, YARN, Hive tuning), solid Spark (Python/Scala) skills, AWS cloud experience, ETL tooling (Informatica) knowledge, and familiarity with NoSQL tools like Cassandra, Drill, and Impala.
Top Skills:
Apache DrillAWSCassandraETLHadoopHdfsHiveImpalaInformaticaInformatica PowercenterPythonScalaSparkYarn
Fintech • Software • Financial Services
Lead and manage onboarding and implementation projects from initiation to launch. Scope solutions, gather requirements, track timelines in Confluence/Airtable, coordinate cross-functional stakeholders, identify and mitigate risks, communicate status to executives, support pre-sales and business development, and apply AI tools to accelerate routine workstreams.
Top Skills:
Ai-Assisted ToolsAirtableAPIsAsanaConfluenceJIRAMondaySalesforceSharepoint
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
