Senior Data Engineer
About The Role
We are looking to expand our data and quantitative department by adding a Senior Data Engineer dedicated to architecting and building robust ETL pipelines and data warehouses to provide foundation for the data team. The role is based in New York City and reports to the Head of Data Science. In this role, you will be architecting and developing robust, scalable, secure and fault-tolerant data pipelines and warehouse with a thoughtful approach centered around data integrity, sensibility and operational scalability. What you build will be the core foundation for data analytics, data science and business intelligence functions, surfacing key, relevant and useful metrics to help drive the key decisions, strategies, and product development of the company.
What you'll do
- Work closely with engineering and business partners to understand data requirements, availability and end use cases
- Architect data warehouse and design scheme structure with thoughtful approach to allow maximum flexibility in use cases with minimum overhead and maintenance
- Onboard data sources via streaming, batch files, APIs, and many others, from counterparties, data vendors, internal data sources, or publicly available data sources
- Build robust, scalable, and fault-tolerant ETL pipelines that allow flexibility and efficiency with minimum overhead and maintenance
- Provide mentorship and hands-on technical leadership to junior data engineers of the team
What you'll need
- BS or above in computer science or engineering
- 5+ years of full-time professional experience in architecting, building and optimizing ETL pipelines and data warehouse to onboard and streamline data cleansing, transformation, standardization and aggregation processes with thoughtful design mindset centered around flexibility, robustness, computing efficiency and maintenance cost
- Hands-on proficiency in Python and SQL along with a deep understanding of the underlying algorithm and execution efficiency
- Comfort in working in a fast-paced environment with moving targets and changing priorities
Extra brownie points for specific experience with
- Familiarity with Kafka, Spark, Snowflake, EMR, Databricks and Looker is a plus
- Proficiency in C or other compiled languages is a plus
- Experience in hosting, provisioning and maintaining database servers in cloud environment, preferably AWS, is a plus
- Experience in efficiency-critical data engineering project, e.g. deduplication, transformation, aggregation of big data, where efficiency of the algorithm makes a difference in computing resource requirement and/or feasibility of the project
- Professional Experience as a back-end engineer is a plus
About YieldStreet
YieldStreet is disrupting the trillion-dollar lending and investment industry. We recently raised $178m in financing from world-class venture capitalists to help us scale. Our investor demand is soaring, and our team is expected to double in size this year. Do you have what it takes to join a booming startup that is changing the investment industry?
We're building the largest global digital wealth management platform to change the way wealth is created. With an investor-first approach, our investor community builds a diversified portfolio of investments outside of the stock market to generate passive income. YieldStreet is giving unprecedented access to asset classes such as Real Estate, Marine, Legal, Art & Commercial. We’re headquartered in New York City with offices in Brazil, Argentina, Malta and Greece.
Benefits
We offer an attractive market compensation and benefits package including a competitive base salary, bonus opportunity, stock option plan, health, dental & vision benefits, life insurance, 401(k) match, unlimited paid vacation, sabbatical and paid holidays and that's before you even step in the office!
This is an opportunity to work with a group of diverse, smart, and friendly people from 8 different countries who speak a total of 17 different languages. Our team is comprised of successful entrepreneurs with combined exits of over $1B, and we get social with each other during happy hours, exercise classes and team off sites in our work hard/play hard culture. We're located in a beautiful new office in Midtown, our building is close to most major subway lines.