Design and implement large-scale data applications using Java, Spark, and MapReduce within Cloudera/Hadoop ecosystems. Integrate Hive, Impala, YARN, and Kafka, perform data analysis, write tests (JUnit), use scripting, and manage global technology teams following industry best practices.
Qualifications
- Minimum 8+ years of relevant experience in applications development
- Expertise in Bigdata ecosystem (Cloudera Distribution) using spark and Map Reduce
- Java (core) 1.8 or above - Hands-on experience (advanced concepts of data structures, memory management and design patterns)
- Apache Spark - Hands on (preferable on Java spark)
- Bigdata ecosystem (Good understanding of Hadoop, preferable cloud era distribution), exposure to Hive, Impala, Yarn, Kafka
- Good Data analysis and programing skills and understanding of large datasets (no sql joins)
- Good knowledge of Java and spark architecture and design principles
- Good experience in Junit/Testing frameworks
- Unix/Python shell scripting experience is a big plus
- Experience managing global technology teams
- Working knowledge of industry practices and standards
- Good communication skills
Photon New York, New York, USA Office
New York, United States
Similar Jobs
Consumer Web • Healthtech • Professional Services • Social Impact • Software
Build, deploy, and iterate AI-powered revenue workflows to automate and scale provider GTM motions. Lead end-to-end Rev Ops initiatives from problem definition and data analysis through implementation, partnering with R&D and Data teams. Shadow reps to design usable processes, measure performance via quantitative analysis, and drive adoption and continuous optimization of AI-native tools and systems.
Top Skills:
APIsAttentionClaudeClayGleanPythonSQL
Consumer Web • Healthtech • Professional Services • Social Impact • Software
Build and own analytics and AI-driven reporting for Care Partnerships. Create self-service insights, predict partner health, prioritize outreach, instrument experiments and launch analytics infrastructure to scale referrals and partner relationships.
Top Skills:
Ai ToolsAnalyticsData ModelingReportingSQL
Artificial Intelligence • Fintech • Insurance • Marketing Tech • Software • Analytics
Handle inbound and warm sales leads, consult customers on insurance needs, match appropriate coverages, close policies, complete paid licensing and training, and work scheduled shifts remotely with required workspace and wired high-speed internet.
Top Skills:
PcWired High-Speed Internet (100 Mbps Down / 20 Mbps Up)
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
