Senior Data Engineer

Sorry, this job was removed at 10:24 a.m. (EST) on Wednesday, February 20, 2019
Find out who's hiring in Greater NYC Area.
See all Data + Analytics jobs in Greater NYC Area
Apply
By clicking Apply Now you agree to share your profile information with the hiring company.

As a Senior Data Engineer at Compass, you will be responsible for helping to build the data-driven decision-making culture throughout the organization. You’ll work as part of a rapidly growing team in a fast-paced environment. You will be responsible for designing and managing large-scale analytical systems that impact multiple functions and teams across the organization. In this high impact role you will have an opportunity to work with emerging technologies, while driving analytical solutions end-to-end. You are someone who loves data and analytics, and strives to constantly learn the new and fast developing data technologies,

At Compass You Will:

  • Design, develop, and implement the infrastructure that elevates data-driven decision-making for our proprietary real estate technology
  • Work with the enterprise business systems that facilitate end to end experience of real estate transactions

This position is responsible for:

  • Design and deliver flexible and scalable AWS Cloud solutions collecting process-level external and internal data and transforming it into enterprise wide data lake, denormalized data marts from which operational and process metrics and analytics can be reliably generated

What We’re Looking For:

  • Bachelor's degree in Computer Science, Information Systems, or related field
  • Extensive experience with AWS platform
  • 3+ years of experience building data lakes and data warehouses in AWS cloud utilizing s3, AWS Lambda, AWS Glue, Kinesis, EMR, Redshift, Data Pipeline, Athena, CloudWatch
  • 10+ years of Data Warehousing experience, building ETL data pipes for populating dimensional marts,
  • Working knowledge of Spark or other distributed processing engines
  • Familiarity with API design patterns (oAuth, tokens, JSON)
  • Experience with supporting Data Science and ML teams, experience supporting notebook environments for analytics/data science teams (Jupyter, Zeppelin, DataBricks)
  • 5+ years of Python experience, and hands on experience with data analysis libraries like Pandas
  • Good understanding of relational databases, Redshift preferred but Oracle, Postrgres or MySQL are ok too
  • Familiarity with dimensional data modeling 
  • Familiarity with ETL tools like Informatica, Pentaho, Talend is a plus
  • Experience with version control, scalable code deployment (Git, Jenkins)
  • Comfortable in Linux environment
  • Strong business communication skills
  • Strong drive to constantly learn and keep up to speed with the new data technologies

At Compass, our mission is to help everyone find their place in the world. This means we continually celebrate the diverse community different individuals cultivate. As an equal opportunity employer, we stay true to our mission by ensuring that our place can be anyone’s place.

Read Full Job Description
Apply Now
By clicking Apply Now you agree to share your profile information with the hiring company.

Location

90 Fifth Avenue, New York, NY 10011

Similar Jobs

Apply Now
By clicking Apply Now you agree to share your profile information with the hiring company.
Learn more about CompassFind similar jobs