Senior Data Engineer

| Greater NYC Area

As a Senior Data Engineer at Compass, you will be responsible for helping to build the data-driven decision-making culture throughout the organization. You’ll work as part of a rapidly growing team in a fast-paced environment. You will be responsible for designing and managing large-scale analytical systems that impact multiple functions and teams across the organization. In this high impact role you will have an opportunity to work with emerging technologies, while driving analytical solutions end-to-end. You are someone who loves data and analytics, and strives to constantly learn the new and fast developing data technologies,

At Compass You Will:

  • Design, develop, and implement the infrastructure that elevates data-driven decision-making for our proprietary real estate technology
  • Work with the enterprise business systems that facilitate end to end experience of real estate transactions

This position is responsible for:

  • Design and deliver flexible and scalable AWS Cloud solutions collecting process-level external and internal data and transforming it into enterprise wide data lake, denormalized data marts from which operational and process metrics and analytics can be reliably generated

What We’re Looking For:

  • Bachelor's degree in Computer Science, Information Systems, or related field
  • Extensive experience with AWS platform
  • 3+ years of experience building data lakes and data warehouses in AWS cloud utilizing s3, AWS Lambda, AWS Glue, Kinesis, EMR, Redshift, Data Pipeline, Athena, CloudWatch
  • 10+ years of Data Warehousing experience, building ETL data pipes for populating dimensional marts,
  • Working knowledge of Spark or other distributed processing engines
  • Familiarity with API design patterns (oAuth, tokens, JSON)
  • Experience with supporting Data Science and ML teams, experience supporting notebook environments for analytics/data science teams (Jupyter, Zeppelin, DataBricks)
  • 5+ years of Python experience, and hands on experience with data analysis libraries like Pandas
  • Good understanding of relational databases, Redshift preferred but Oracle, Postrgres or MySQL are ok too
  • Familiarity with dimensional data modeling 
  • Familiarity with ETL tools like Informatica, Pentaho, Talend is a plus
  • Experience with version control, scalable code deployment (Git, Jenkins)
  • Comfortable in Linux environment
  • Strong business communication skills
  • Strong drive to constantly learn and keep up to speed with the new data technologies

At Compass, our mission is to help everyone find their place in the world. This means we continually celebrate the diverse community different individuals cultivate. As an equal opportunity employer, we stay true to our mission by ensuring that our place can be anyone’s place.

Read Full Job Description
Apply now
loading ...
Emailed

Technology we use

  • Engineering
    • JavaLanguages
    • JavascriptLanguages
    • PythonLanguages

Location

90 Fifth Avenue, 3rd Floor, New York, NY 10011

What are Compass Perks + Benefits

Compass Benefits Overview

Enjoy premium health insurance, gym and tuition reimbursement, team events, and fun extras.

Health Insurance & Wellness Benefits
Dental Benefits
Vision Benefits
Health Insurance Benefits
Retirement & Stock Options Benefits
401(K)
Company Equity
Child Care & Parental Leave Benefits
Generous Parental Leave
Flexible Work Schedule
Vacation & Time Off Benefits
Generous PTO
Paid Volunteer Time
Sabbatical
Paid Holidays
Paid Sick Days
Perks & Discounts
Beer on Tap
Casual Dress
Commuter Benefits
Company Outings
Free Daily Meals
Game Room
Stocked Kitchen
Some Meals Provided
Compass provides daily catered lunch to all employees.
Happy Hours
Fitness Subsidies
Professional Development Benefits
Job Training & Conferences
Tuition Reimbursement
More Jobs at Compass159 open jobs
All Jobs
Finance
Data + Analytics
Design + UX
Dev + Engineer
HR
Internships
Legal
Marketing
Operations
Product
Project Mgmt
Sales
Content
Operations
new
New York
Finance
new
New York
Content
new
New York
Marketing
new
New York
Marketing
new
New York
Operations
new
New York
Operations
new
New York
Design + UX
new
New York
Design + UX
new
New York
HR
new
New York
Operations
new
New York
Operations
new
New York
Operations
new
New York
Design + UX
new
New York
Developer
new
New York
Developer
new
New York
Finance
new
New York
Operations
new
New York
Marketing
new
New York
Marketing
new
New York
Design + UX
new
New York
Operations
new
New York
Developer
new
New York
Sales
new
New York
Sales
new
New York
Sales
new
New York
Content
new
New York
Marketing
new
New York
HR
new
New York
Operations
new
New York
Operations
new
New York
Design + UX
new
New York
Data + Analytics
new
New York
Design + UX
new
New York
Finance
new
New York
Data + Analytics
new
New York
Developer
new
New York
Design + UX
new
New York
HR
new
New York
Finance
new
New York
Operations
new
New York
HR
new
New York
Marketing
new
New York
Product
new
New York
Developer
new
New York
Finance
new
New York
Operations
new
New York
Developer
new
New York
Operations
new
New York
Design + UX
new
New York
Project Mgmt
new
New York
Operations
new
New York
Developer
new
New York
Developer
new
New York
Developer
new
New York
Design + UX
new
New York
Project Mgmt
new
New York
HR
new
New York
Product
new
New York
Data + Analytics
new
New York
Design + UX
new
New York
HR
new
New York
Product
new
New York
Project Mgmt
new
New York
HR
new
New York
Operations
new
New York
Project Mgmt
new
New York
Sales
new
New York
Finance
new
New York
Data + Analytics
new
New York
Operations
new
New York
HR
new
New York
Data + Analytics
new
New York
HR
new
New York
Marketing
new
New York
Developer
new
New York
Developer
new
New York
Developer
new
New York
Developer
new
New York
Operations
new
New York
Developer
new
New York
Developer
new
New York
Developer
new
New York
Developer
new
New York
Marketing
new
New York
Design + UX
new
New York
Marketing
new
New York
Product
new
New York
Sales
new
New York
Operations
new
New York
Operations
new
New York
Finance
new
New York
Marketing
new
New York
Developer
new
New York
Operations
new
New York
Marketing
new
New York
Internships
new
New York
Finance
new
New York
Project Mgmt
new
New York
Marketing
new
New York
Marketing
new
New York
Finance
new
New York
Finance
new
New York
Data + Analytics
new
New York
Finance
new
New York
HR
new
New York
Data + Analytics
new
New York