Design and implement large-scale data applications using Java, Spark, and MapReduce within Cloudera/Hadoop ecosystems. Integrate Hive, Impala, YARN, and Kafka, perform data analysis, write tests (JUnit), use scripting, and manage global technology teams following industry best practices.
Qualifications
- Minimum 8+ years of relevant experience in applications development
- Expertise in Bigdata ecosystem (Cloudera Distribution) using spark and Map Reduce
- Java (core) 1.8 or above - Hands-on experience (advanced concepts of data structures, memory management and design patterns)
- Apache Spark - Hands on (preferable on Java spark)
- Bigdata ecosystem (Good understanding of Hadoop, preferable cloud era distribution), exposure to Hive, Impala, Yarn, Kafka
- Good Data analysis and programing skills and understanding of large datasets (no sql joins)
- Good knowledge of Java and spark architecture and design principles
- Good experience in Junit/Testing frameworks
- Unix/Python shell scripting experience is a big plus
- Experience managing global technology teams
- Working knowledge of industry practices and standards
- Good communication skills
Photon New York, New York, USA Office
New York, United States
Similar Jobs
Artificial Intelligence • Cloud • Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
The Senior Sales Representative sells group insurance products, develops broker relationships, secures growth opportunities, and drives new business while managing client needs.
Top Skills:
MS Office
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Provide telephonic nursing case management including assessment, care planning, coordination of discharge and follow-up, high-risk patient monitoring, motivational interviewing, documentation in the EHR, and collaboration with physicians and care teams to reduce readmissions and optimize outcomes.
Top Skills:
Care Management DashboardsElectronic Health Record
Yesterday
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Oversees daily clinical operations for Hematology/Oncology, Radiation Oncology, and Infusion Center services. Supervises staff, ensures competent compassionate patient care, supports accreditation, coordinates multidisciplinary teams, and may cross-cover centers or travel as needed.
Top Skills:
AriaBeaconEpicMS Office
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
