Photon Logo

Photon

Architect - Data Engineering - Jersey City

Sorry, this job was removed at 06:27 a.m. (EST) on Tuesday, Sep 01, 2026
In-Office or Remote
2 Locations
64K-225K Annually
Expert/Leader
In-Office or Remote
2 Locations
64K-225K Annually
Expert/Leader

Similar Jobs

43 Minutes Ago
Remote or Hybrid
45K-85K Annually
Junior
45K-85K Annually
Junior
Artificial Intelligence • Fintech • Insurance • Marketing Tech • Software • Analytics
Handles inbound calls and warm leads, consults customers on insurance needs, recommends appropriate coverages, and converts prospects into policyholders. The role includes paid Property and Casualty licensing and sales training, customer relationship management, brand representation, and schedule-based remote work. Employees must work four weekdays and one weekend day, maintain a dedicated home workspace with wired high-speed internet, and remain in their resident state for at least one year.
Top Skills: High-Speed Wired InternetPcProperty And Casualty Insurance License
An Hour Ago
Remote or Hybrid
IL, USA
111K-150K Annually
Senior level
111K-150K Annually
Senior level
Artificial Intelligence • Cloud • Information Technology • Sales • Security • Software • Cybersecurity
Drives Rapid7 solution adoption and joint revenue growth through CDW by delivering technical demos, proof-of-concept evaluations, training, enablement plans, and solution guidance. Partners with account managers, sales engineers, sellers, and customers to support opportunities, explain technical value, resolve complex questions, and strengthen channel relationships. Requires consistent travel to CDW headquarters in Chicago and partner offices.
Top Skills: Application SecurityAWSCloud SecurityDevOpsGoogle Cloud Platform (Gcp)Incident ResponseAzureRapid7Security AutomationVulnerability Management
2 Hours Ago
Remote or Hybrid
164K-297K Annually
Expert/Leader
164K-297K Annually
Expert/Leader
Fintech • Payments • Software • Financial Services
Lead commercialization of emerging AI products by securing enterprise customers and strategic partners, structuring pilots, and converting them into scaled relationships. Own engagements from prospecting and negotiation through launch and optimization, while partnering with Product and Engineering to shape product strategy, pricing, implementation, and go-to-market models.
Top Skills: AICloud InfrastructureData InfrastructureDeveloper Platforms
Design and architect large-scale distributed data solutions using Spark and Cloudera CDH. Build and optimize ETL pipelines, ensure data integrity/security, troubleshoot performance, and implement version control and CI/CD for Spark applications while collaborating with data scientists and stakeholders.
The summary above was generated by AI

Key Responsibilities: 

  • Architect and design large-scale, distributed big data solutions using Java and big data technologies to handle high-volume data processing and analytics. 
  • Optimize and tune Spark applications for better performance on large-scale data sets. 
  • Work with the Cloudera Hadoop ecosystem (e.g., HDFS, Hive, Impala, HBase, Kafka) to build data pipelines and storage solutions. 
  • Collaborate with data scientists, business analysts, and other developers to understand data requirements and deliver solutions. 
  • Design and implement high-performance data processing and analytics solutions. 
  • Ensure data integrity, accuracy, and security across all processing tasks. 
  • Troubleshoot and resolve performance issues in Spark, Cloudera, and related technologies. 
  • Implement version control and CI/CD pipelines for Spark applications.  

Required Skills & Experience: 

  • Minimum 15+ years of experience in application development. 
  • Strong hands on experience in Apache Spark, Scala, and Spark SQL for distributed data processing. 
  • Hands-on experience with Cloudera Hadoop (CDH) components such as HDFS, Hive, Impala, HBase, Kafka, and Sqoop. 
  • Familiarity with other Big Data technologies, including Apache Kafka, Flume, Oozie, and Nifi. 
  • Experience building and optimizing ETL pipelines using Spark and working with structured and unstructured data. 
  • Experience with SQL and NoSQL databases such as HBase, Hive, and PostgreSQL. 
  • Knowledge of data warehousing concepts, dimensional modeling, and data lakes. 
  • Ability to troubleshoot and optimize Spark and Cloudera platform performance. 
  • Familiarity with version control tools like Git and CI/CD tools (e.g., Jenkins, GitLab). 

Compensation, Benefits and Duration

Minimum Compensation: USD 64,000
Maximum Compensation: USD 225,000
Compensation is based on actual experience and qualifications of the candidate. The above is a reasonable and a good faith estimate for the role.
Medical, vision, and dental benefits, 401k retirement plan, variable pay/incentives, paid time off, and paid holidays are available for full time employees.
This position is not available for independent contractors
No applications will be considered if received more than 120 days after the date of this post

Photon New York, New York, USA Office

New York, United States

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account