Data Engineer

| Greater NYC Area
Sorry, this job was removed at 10:25 a.m. (EST) on Wednesday, February 20, 2019
Find out who's hiring in Greater NYC Area.
See all Data + Analytics jobs in Greater NYC Area
Apply
By clicking Apply Now you agree to share your profile information with the hiring company.

As a Data Engineer at Compass, you will be responsible for helping to build the data-driven decision-making culture throughout the organization. You’ll work as part of a rapidly growing team in a fast-paced environment. You will be responsible for designing and managing large-scale data systems that impact multiple functions and teams across the organization. In this high impact role you will have an opportunity to work with emerging technologies, while driving data warehousing solutions end-to-end. You are someone who loves data and analytics, understands enterprise information systems, and has a strong business sense.

At Compass You Will:

  • Design, develop, and implement the infrastructure that elevates data-driven decision-making for our proprietary real estate technology
  • Work with the enterprise business systems that facilitate end to end experience of real estate transactions
  • Work with company business stakeholders and Product and Engineering teams to define analytical requirements
  • Deliver flexible and scalable solutions collecting process-level data and transforming it into enterprise wide data warehouse from which operational and process metrics and analysis can be reliably generated

This position is responsible for:

  • Drive the design, build and implementation of new data models in production
  • Utilizing the best practices, design and build highly performant Redshift database structures
  • Participate in defining the enterprise data architecture - data lake, data warehouse and required ETL processes
  • Define and implement processes required to achieve high Redshift system reliability
  • Perform Redshift database administration activities – database sizing, performance monitoring, identifying and optimizing low performing processes

 What we’re looking for:

  • Bachelor's degree in Computer Science, Information Systems, or related field
  • 10+ years of experience building Data Warehouses
  • Working knowledge of relational databases;
  • 5+ years hands on experience building dimensional data marts and scalable ETL data pipes
  • Strong hands on experience with Amazon Redshift database and understanding it’s innerworkings is a must
  • Expert level knowledge of dimensional modeling and master data management
  • Understanding Redshift database design best practices, and extensive experience building large Redshift databases 
  • Experience with managing Amazon Redshift clusters and AWS platform
  • Familiarity with ETL tools like Informatica, Pentaho, Talend is a big plus
  • Experience working with structured, semi-structured and non-structured data sources
  • Familiarity with distributed processing technologies like EMR, Hive, Spark 
  • Python scripting experience, and understanding of data analysis libraries like Pandas is a plus
  • Comfortable in Linux environment
  • Strong business communication skills

At Compass, our mission is to help everyone find their place in the world. This means we continually celebrate the diverse community different individuals cultivate. As an equal opportunity employer, we stay true to our mission by ensuring that our place can be anyone’s place.

Check out our Engineering blog!

Read Full Job Description
Apply Now
By clicking Apply Now you agree to share your profile information with the hiring company.

Location

90 Fifth Avenue, New York, NY 10011

Similar Jobs

Apply Now
By clicking Apply Now you agree to share your profile information with the hiring company.
Learn more about CompassFind similar jobs