Senior Data Engineer
EquityZen is an early-mid stage financial technology company, backed by leading venture and private equity investors. We enable private companies to deliver liquidity to their shareholders while providing investors access to invest in these proven, pre-IPO companies. EquityZen has served 125+ premier tech and digital health companies and is proud to be considered a liquidity provider for 1 out of 3 of the largest unicorns. We’re moving fast, with double and in some cases triple-digit percentage growth across metrics including headcount, transaction volume, revenue and users over the past year. Watch this short video to learn more: https://equityzen.com/press/.
We’re looking for an experienced Senior Data Engineer to join our growing team as we rapidly expand our industry-defining online investment platform. Our ideal candidate has substantial experience in architecting efficient pipelines including data ingestion/pre-processing, data quality/governance and impactful machine learning pipelines. The impact on the business manifests in complex workflow automation and improved research and reporting capabilities. Our team is a group of ambitious, yet humble people across all disciplines and backgrounds. Our commitment is to an efficient interview process and as long as we can align with schedules, our start to decision can be within 2-3 weeks. If our team and values interest you and you’d like to work in a company poised for hyper-growth, please reach out to us!
WHAT YOU’LL DO
- Become a core maintainer of our data lake with building and making available a searchable set of datasets for use by our broader business for intelligence, research and auditing/lineage use-cases.
- Assist with key areas of back end development including but not limited to data pipelines/ETL, machine learning and serving, feature engineering, model cataloging, testing and deployment tooling in order to build an efficient, high quality CICD pipeline.
- Work hand-in-hand with designers, PMs, data scientists, business stakeholders, and fellow engineers to ideate, design, and implement key initiatives and end-user experiences that are used by tens of thousands of customers as well as our internal teams
- Use cutting-edge technologies and domain-driven design fundamentals and introduce improvements to our stack, end-user experience, business processes, and workflows via rapid prototypes/proof-of-concepts.
- Translate data science concepts to high quality machine learning pipelines expanding on both offline and online prediction using relevant techniques. Our problems span both traditional numerical/categorical prediction, NLP solutions including document parsing and building recommendation engines.
- Work on integrating with a service oriented architecture including building microservices and migrating to an event driven pub-sub framework
- Collaborate with our agile team that champions software development best practices
THE RIGHT STUFF
- BS in Computer Science or related discipline
- 4+ years experience working with both smaller and large scale analytical tools such as scikit-learn/pandas, spark (scala or python), tensorflow.
- 5+ years of professional experience working with a core language such as python or scala in order to be able to leverage the relevant analytical tools.
- Well versed in all aspects of SDLC including CICD and automated testing is a must-have.
- Demonstrated experience in building ETL and ML pipelines including being able to orchestrate more complex pipelines using DAG based schedules.
- Prior experience with scheduling tools such as Airflow, Luigi, Kubeflow is essential.
- Experience working in a fast-paced, lean organization that is 100% accountable for its commitments
- Able to take high-level requests, break them down to digestible tasks, and own them to completion
- Passionate about writing maintainable code, automated testing, and thorough code review
OUR TECH STACK
EquityZen runs a robust stack which is containerized and deployed on Kubernetes in the AWS cloud. On the front end, we leverage React, Redux and GraphQL. On the back end we use Python, Django, Celery, PostgreSQL, Golang, ElasticSearch, and RabbitMQ. We are continuously evolving our architecture to match our growing scale and will be working with pub sub frameworks including Kafka as well as building out our data mesh.
BONUS POINTS IF YOU HAVE
- Track record of technical leadership and delivery of large projects that require strong teamwork and collaboration
- Strong distributed systems knowledge including working in environments with monitoring (e.g. Prometheus, Datadog), Alerting (e.g. Pagerduty) and devops experience (k8s, terraform, cloudformation) in an AWS stack
- Experience with distributed streaming systems such as Kafka/Kinesis/Pulsar
- Experience with relational databases (Postgres, Mysql) and non relational stores (Mongo, Cassandra, Scylla)
- Experience mentoring team members on new technologies
- Experience conducting product demonstrations for non-technical users
- Entrepreneurial and/or start up experience
- Prior work in financial services or the FinTech sector
- First hand understanding of marketplace businesses
- Technical leadership on larger projects that span multiple functions and required strong product management collaboration
WHAT YOU'LL GAIN
- Experience working on a fast growing and fast moving team who is passionate about building amazing products that provide high value to our customers and are a pleasure to use
- Hands on experience with the venture capital and technology-driven startup ecosystems
- Opportunity to work closely with business stakeholders across the entire organization, including the founding team
- Equity, competitive salary, full employee benefits (health, dental, vision), flexible paid time off, stocked fridge, supply of snacks, weekly catered lunch and more!
- Hybrid/Remote work environment for engineering members with an emphasis on work-life balance
- Strong career progression paths are available for all tracks including individual contributors and aspiring managers.
EquityZen offers a competitive salary, stock options, full employee benefits (health, dental, vision), 401k match, individual professional development and wellness budget, generous time off policies and more!
To maximize cross-team collaboration, productivity and engagement, unless otherwise stated, it is expected that all employees work in our spacious new office in the financial district on a hybrid schedule. We appreciate that different teams and roles may have different requirements, so we focus on "presence with a purpose". Working from the office requires being fully vaccinated, signing an attestation stating as such and providing proof of vaccination. We are always dedicated to prioritizing all employees’ health and safety and accommodations will be made as required.
EquityZen provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability or genetics. In addition to federal law requirements, EquityZen complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training. EquityZen expressly prohibits any form of workplace harassment based on race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status. Improper interference with the ability of EquityZen’s employees to perform their job duties may result in discipline up to and including discharge.