Senior Big Data Developer

| Greater NYC Area

ADP is hiring an experienced Big Data Developer with demonstrated experience in AWS, streaming solutions and data lake processing. Does this sound like you?

  • Self-Starter. High-reaching and unstoppable. A can't-stop-won't-stop attitude and an urge to persevere until you get it right Analytical mastermind.
  • Hacker's spirit. Tinkers and deciphers to unravel and interpret the inner workings of the system.
  • Critical thinker. Problem solver who can find a solution for anything using strategy as a compass.
  • Initiator. Makes it happen.

We believe people make great companies, not the other way around. Our people make all the difference in delivering innovative HR technologies and solutions that help employees all over the world do their jobs better. The result? We're building the next generation of ADP technologies.

As a Big Data Developer you will be part of the Data Science Architecture team driving the change and technical innovation to build big data cloud applications supporting reporting, analytics and machine learning. We look for self-starters who thrive in a fast-paced, agile environment being able to change direction quickly, and showing an eagerness to learn new technologies as the need arises. This position requires hands on coding & strong development background. In this role you will join the exciting ADP Data cloud team working on the latest Big Data technologies (Spark,Kafka,EMR,Glue) to layout the application framework and infrastructure foundation using your Data Engineering & Big Data processing skills.

THINGS YOU'LL DO:

  • Work with other team members to understand the business challenges and propose the best technical solutions.
  • Help design the best Data Lake platform to support the capacity and performance requirements.
  • Design and implement data processing and machine learning pipelines.
  • Performance tuning of Spark jobs.
  • Write automation code to create and configure infrastructure resources needed to run applications.
  • Create an end to end fully automated analytics production flow. From Data ingestion to data and analytics ready to be consumed by customer facing API.

EXPERIENCE YOU NEED:

  • Python or any other language experience in big data and analytics development.
  • Solid experience with PySpark, Spark SQL and various python libraries.
  • Proficiency with AWS cloud.
  • Experience with entire SDLC and working with tools such as Git, Jenkins, Artifactory.
  • Experience in Data Engineering pipelines with Spark or other technologies.
  • Experience ingesting data from databases to the data lake.
  • Experience with data quality, data shape and anomaly monitoring.
  • Working with notebooks to create data analyses, reports and dashboards.
  • Understanding of file formats like Parquet, Avro, Hudi/Delta/Iceberg.
  • AWS experience with services like S3, EMR, Kinesis, Glue, Athena, Glue, Step Functions, DMS, Lambda.
  • Strong hands on experience creating big data applications using Hadoop, Spark, Columnar/MPP databases, Kafka, Spark structured streaming.
  • Experience with CDC ingestion mechanisms nice to have.
  • Bachelor or Masters degree in Computer Science preferred.
 

 

#LITECH
 

 

We're designing a better way to work, so you can achieve what you're working for. Consistently named one of the 'Most Admired Companies' by FORTUNE® Magazine, and recognized by DiversityInc® as one of the 'Top 50 Companies for Diversity,' ADP works with more than 740,000 organizations across the globe to help their people work smarter, embrace new challenges, and unleash their talent. "Always Designing for People" means we're creating platforms that will transform how great work gets done, so together we can unlock a world of opportunity.

At ADP, we believe that diversity fuels innovation. ADP is committed to equal employment opportunities regardless of race, color, genetic information, creed, religion, sex, sexual orientation, gender identity, lawful alien status, national origin, age, marital status, or protected veteran status. We support an inclusive workplace where associates excel based on personal merit, qualifications, experience, ability, and job performance.

Read Full Job Description

Technology we use

  • Engineering
  • Product
    • GolangLanguages
    • JavascriptLanguages
    • PythonLanguages
    • ScalaLanguages
    • ReactLibraries
    • ReduxLibraries
    • Node.jsFrameworks
    • TensorFlowFrameworks
    • MySQLDatabases
    • PostgreSQLDatabases
    • RedisDatabases
    • JIRAManagement

Location

Our office is a converted loft space in Chelsea steps away from shopping, galleries, coffee, and great food (that is, if you want to skip free lunch).

An Insider's view of Lifion by ADP

What are some social events your company does?

There are lots of events constantly going on at Lifion! From meetups to tech talks to our weekly Thursday happy hours, there's a good mix of work and play. We also do outings: in my one year of working here we’ve done laser tag, Barcade, happy hour on a boat, the vessel, a picnic in central park, escape the room, VR world, and more.

Kelsey

Application Developer

What's the biggest problem your team is solving?

The People Ops Team is in full swing for FY19 Performance Reviews. It's an exciting time for the business, but requires a lot of backend work & support for our associates. We're drafting communications and timelines for management & associates, and creating the right process to gather ratings and self-assessments for a great associate experience.

Quinton

Director, People Operations

How has your career grown since starting at the company?

I have been able to work with many different teams since I started here and have grown tremendously. I have worked with new product teams, Reliability teams and now work with Security and Compliance teams. This experience has enriched my technical and product knowledge, and I get to be part of the teams which are solving complex business problems.

Gargi

Technical Program Manager

How do you empower your team to be more creative?

Creativity is best fueled by collaboration, and has two simple ingredients: First, you hire passionate & talented people, people who care about users and who want to solve meaningful complex problems. Then, you support a culture of openness, with every designer constantly sharing their best ideas across the whole org. That's how creativity thrives!

Chris

Head of UX

What makes someone successful on your team?

Success on our team is enjoying ownership over our work while staying open to suggestions. We have an open-door policy to share knowledge with one another, strengthening us individually and as a team. We check our egos at the door and are lucky enough to be surrounded by people who feel like family more than coworkers.

Sam

Software Engineer

What are Lifion by ADP Perks + Benefits

Culture
Friends outside of work
Eat lunch together
Daily stand up
Open door policy
Team owned deliverables
Team based strategic planning
Group brainstorming sessions
Pair programming
Open office floor plan
Diversity
Dedicated Diversity/Inclusion Staff
Unconscious bias training
Diversity manifesto
Someone's primary function is managing the company’s diversity and inclusion initiatives
Diversity Employee Resource Groups
Hiring Practices that Promote Diversity
Health Insurance & Wellness Benefits
Flexible Spending Account (FSA)
Disability Insurance
Dental Benefits
Vision Benefits
Health Insurance Benefits
Life Insurance
Pet Insurance
Wellness Programs
Onsite Gym
Mental Health Benefits
Retirement & Stock Options Benefits
401(K)
401(K) Matching
Employee Stock Purchase Plan
Performance Bonus
Match charitable contributions
Child Care & Parental Leave Benefits
Child Care Benefits
Family Medical Leave
Adoption Assistance
Vacation & Time Off Benefits
Generous PTO
Paid Volunteer Time
Paid Holidays
Paid Sick Days
Perks & Discounts
Casual Dress
Free Daily Meals
Stocked Kitchen
Happy Hours
Fitness Subsidies
Professional Development Benefits
Tuition Reimbursement
Lunch and learns
Promote from within
Mentorship program
Continuing Education stipend
Online course subscriptions available
More Jobs at Lifion by ADP50 open jobs
All Jobs
Data + Analytics
Design + UX
Dev + Engineer
Internships
Operations
Product
Project Mgmt
Developer
new
New York
Developer
new
New York
Developer
new
New York
Developer
new
New York
Developer
new
New York
Developer
new
New York
Developer
new
New York
Developer
new
New York
Developer
new
New York
Developer
new
New York
Project Mgmt
new
New York
Data + Analytics
new
New York
Developer
new
New York
Product
new
New York
Developer
new
New York
Developer
new
New York
Developer
new
New York
Data + Analytics
new
New York
Project Mgmt
new
New York
Data + Analytics
new
New York
Product
new
New York
Operations
new
North Jersey
Developer
new
New York
Developer
new
New York
Developer
new
New York
Developer
new
New York
Developer
new
New York
Developer
new
New York
Developer
new
New York
Data + Analytics
new
New York
Operations
new
New York
Data + Analytics
new
New York
Operations
new
New York
Developer
new
New York
Developer
new
New York
Data + Analytics
new
New York
Developer
new
New York