Design, build, and support complex batch and streaming data pipelines from structured and unstructured sources. Collaborate with engineering and analytics to deliver accurate, performant data, automate processes, maintain dev/test/prod environments, and participate in on-call rotation.
Redfin is revolutionizing the $75 billion real estate industry. We use data, beautiful software, and innovative design to put customers first at every step in the home-buying and selling process. Get ready to dive headfirst into our award-winning website and mobile apps, solving complex business problems in a highly visible, customer-centric way. If you value doing great work in a collaborative environment, join our team!
As a Data Engineer II, you will share ownership of Redfin's Data Platform, owning business critical data integrations and operational excellence. You will work closely with Engineering and Analytics teams to create and support data pipelines and transformations. The ideal candidate is a data pipeline builder who enjoys optimizing existing systems as well as building new systems from the ground up. We are also looking for someone who is self-directed and comfortable supporting the data needs of multiple systems and teams.
About the r ole
About y ou
What y ou'll g et
Our t eam me mbers fuel our strategy, innovation and growth, so we ensure the health and well-being of not just you, but your family, too! We go above and beyond to give you the support you need on an individual level and offer all sorts of ways to help you live your best life. We are proud to offer eligible team members perks and health benefits that will help you have peace of mind. Simply put: We've got your back. Check out our full list of Benefits and Perks.
About u s
Redfin is a technology-driven real estate company with the country's most-visited real estate brokerage website. As part of Rocket Companies (NYSE: RKT), Redfin is creating an integrated homeownership platform from search to close to make the dream of homeownership more affordable and accessible for everyone. Redfin's clients can see homes first with on-demand tours, easily apply for a home loan with Rocket Mortgage, and save thousands in fees while working with a top local agent.
This job description is an outline of the primary responsibilities of this position and may be modified at the discretion of the c ompany at any time. Decisions related to employment are not based on race, color, religion, national origin, sex, physical or mental disability, sexual orientation, gender identity or expression, age, military or veteran status or any other characteristic protected by state or federal law. The c ompany provides reasonable accommodations to qualified individuals with disabilities in accordance with applicable state and federal laws. Applicants requiring reasonable accommodations in completing the application and/or participating in the application process should contact a member of the Human Resources team, at [email protected] .
The compensation information below is provided in compliance with all applicable job posting disclosure requirements. The compensation for this position is $119,900.00-$162,200.00. The position may also be eligible for an annual bonus, incentives, and other employment-related benefits including, but not limited to, medical, dental, and vision benefits, 401K retirement plan, and paid-time off. More information regarding these benefits and others can be found here . The information regarding compensation and other benefits included in this paragraph is the company's current, good faith estimate at the time of posting. [Compensation and benefits are subject to modification from time to time as the Company, in its sole and exclusive discretion, deems appropriate .] The Company may determine during its future reviews of the proposed compensation and benefits provided for this position, that the compensation and benefits for such position should be reduced. In no event will the Company reduce the compensation for the position to a level below the applicable jurisdictional minimum wage rate for the position. Los Angeles County and San Francisco Candidates only: qualified applicants with arrest or conviction records will be considered for employment per the Fair Chance Ordinance and the Fair Chance Initiative for Hiring.
As a Data Engineer II, you will share ownership of Redfin's Data Platform, owning business critical data integrations and operational excellence. You will work closely with Engineering and Analytics teams to create and support data pipelines and transformations. The ideal candidate is a data pipeline builder who enjoys optimizing existing systems as well as building new systems from the ground up. We are also looking for someone who is self-directed and comfortable supporting the data needs of multiple systems and teams.
About the r ole
- Design, develop, and support complex data pipelines from a wide variety of data sources for Redfin
- Work with other Engineering teams to design and implement data exchange systems from structured and unstructured data sources
- Work with end users to gather requirements and design solutions that provide the the data they need in the format they need it in
- Ensure 100% accuracy in everything you do - make sure that all code and processes are fully tested and verified before running in production
- Identify and implement internal process improvements by automating manual processes and optimizing for accuracy, performance and coding best practices
- Support and maintain dev / test / prod environments
- Serve as part of weekly on call rotation
About y ou
- 3+ years experience with a modern programming language (Python, Java, etc). Python is preferred
- 3+ years experience with complex SQL, data modeling and database technologies (Postgres, MySQL, Snowflake, etc). Snowflake is preferred
- Experience creating and maintaining complex data pipelines
- Experience with batch and streaming data pipelines
- Experience with both structured and unstructured data sets
- Ability to translate business needs into technical requirements
- Experience with Git / Jenkins / Airflow / Docker / Kubernetes / Spark is a plus
- Experience with API development is a plus
- Experience with cloud services (AWS / Azure / GCP) is a plus. AWS is preferred
- Ability to structure data to make it accessible, performant, and resilient to change
- Experience with message queuing and stream processing data is a plus
- Ability to handle ambiguity and function in a fast paced, constantly changing environment
- Ability to communicate well with both technical and non technical users
What y ou'll g et
Our t eam me mbers fuel our strategy, innovation and growth, so we ensure the health and well-being of not just you, but your family, too! We go above and beyond to give you the support you need on an individual level and offer all sorts of ways to help you live your best life. We are proud to offer eligible team members perks and health benefits that will help you have peace of mind. Simply put: We've got your back. Check out our full list of Benefits and Perks.
About u s
Redfin is a technology-driven real estate company with the country's most-visited real estate brokerage website. As part of Rocket Companies (NYSE: RKT), Redfin is creating an integrated homeownership platform from search to close to make the dream of homeownership more affordable and accessible for everyone. Redfin's clients can see homes first with on-demand tours, easily apply for a home loan with Rocket Mortgage, and save thousands in fees while working with a top local agent.
This job description is an outline of the primary responsibilities of this position and may be modified at the discretion of the c ompany at any time. Decisions related to employment are not based on race, color, religion, national origin, sex, physical or mental disability, sexual orientation, gender identity or expression, age, military or veteran status or any other characteristic protected by state or federal law. The c ompany provides reasonable accommodations to qualified individuals with disabilities in accordance with applicable state and federal laws. Applicants requiring reasonable accommodations in completing the application and/or participating in the application process should contact a member of the Human Resources team, at [email protected] .
The compensation information below is provided in compliance with all applicable job posting disclosure requirements. The compensation for this position is $119,900.00-$162,200.00. The position may also be eligible for an annual bonus, incentives, and other employment-related benefits including, but not limited to, medical, dental, and vision benefits, 401K retirement plan, and paid-time off. More information regarding these benefits and others can be found here . The information regarding compensation and other benefits included in this paragraph is the company's current, good faith estimate at the time of posting. [Compensation and benefits are subject to modification from time to time as the Company, in its sole and exclusive discretion, deems appropriate .] The Company may determine during its future reviews of the proposed compensation and benefits provided for this position, that the compensation and benefits for such position should be reduced. In no event will the Company reduce the compensation for the position to a level below the applicable jurisdictional minimum wage rate for the position. Los Angeles County and San Francisco Candidates only: qualified applicants with arrest or conviction records will be considered for employment per the Fair Chance Ordinance and the Fair Chance Initiative for Hiring.
Similar Jobs at Redfin
Real Estate • PropTech
Own Redfin’s conversion funnel and product strategy, driving high-velocity A/B experimentation to increase agent and mortgage contacts. Develop roadmaps, requirements, and product designs; analyze data; align executives and cross-functional teams; influence technical direction; and deliver measurable growth across Redfin and Rocket businesses.
Top Skills:
A/B Testing
Real Estate • PropTech
Lead strategic execution for a 45+ person enterprise data organization to deliver a unified multi-tenant Data Lakehouse. Drive migration from legacy ETL to Snowflake-managed Iceberg on S3, enable secure data sharing and RBAC, scale MLOps and data products, manage cross-domain dependencies, and establish agile operating rhythms with engineering leadership to deliver on-time with zero disruption.
Top Skills:
Azure Devops (Ado)Data LakehouseData MeshElt PipelinesETLIcebergMlopsS3Snowflake
Real Estate • PropTech
Lead security, compliance, and infrastructure reliability programs across engineering. Own quarterly planning, roadmaps, and cross-team execution; identify risks, remove blockers, measure outcomes, and report program status to senior leadership.
Top Skills:
AWSCloud GovernanceDatabasesKubernetesNetworkingStreaming
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
