Senior Manager of Data Engineering
LeafLink is the largest unified B2B cannabis platform, providing licensed cannabis businesses a suite of tools to manage their business more effectively, sell or order from their favorite brands and accelerate growth. We are one platform, one solution and we’re defining the way thousands of cannabis brands, distributors and retailers streamline their operations. With thousands of brands and retailers across 30+ markets in North America, we are setting the industry standard for how cannabis businesses grow together. LeafLink processes more than $4.4 billion in wholesale cannabis orders annually.
Our team, backed by funding from leading VC's, including Founders Fund, Thrive Capital, Nosara Capital, and Lerer Hippeau is poised to define the cannabis supply chain through technology. LeafLink was named one of Inc. 5000’s ‘Top 5000 Fastest-Growing Private Companies’, one of Built In NYC's 'Best Places to Work in 2021', as well as one of Fast Company's 'Top 10 Most Innovative Companies in Enterprise for 2020', joining the ranks of Amazon, Slack, and VMWare - and we're just getting started!
The Role
LeafLink is seeking a Senior Manager of Data Engineering. This person will manage data assets like the data lake, warehouse, data APIs and support enterprise wide applications of data like BI & Analytics, ML and data-driven features. The role will involve hiring, managing and mentoring a team of Data Engineers and play a leading role in development and direction of LeafLink’s Data Platform. Reporting to the VP / Director of Data Engineering & Analytics, this role will be responsible for management and growth of a team of data engineers, oversee day to day operations related to LeafLink’s analytics infrastructure and processes, and drive execution of data engineering projects.
Ideal candidates for this role possess the ability to think strategically, define robust solutions, organize, plan and deliver on complex projects. Cross functional collaboration, driving initiatives, and being the go-to expert for technical solutions relating to data engineering and analytics, mentoring and growing teams should come naturally to the candidate. Other important qualities we are looking for are a passion for modern data architecture, ability to simplify complex data structures, curiosity to understand stakeholder’s end use case and applications of data, experience working alongside and supporting data analysts, data scientists and engineers.
Responsibilities
- Manage various components of the data platform like ingestion engines, data warehouse, APIs, Slack Apps and tools like dbt, Airflow, Census etc.
- Manage administration of the data warehouse including provisioning and permissioning, utilization, updates, schema maintenance etc.
- Build a robust data catalog for sharing data assets between producers and consumers
- Manage and scale data pipelines from internal and external data sources to support new product launches and drive data quality across data products
- Establish rigorous and robust data quality testing processes and SLAs for resolution of types of data quality issues
- Troubleshoot and resolve all issues related to the data platform like data pipeline bugs, data quality issues, service outages and other such events
- Develop and maintain documentation like ERDs, data dictionaries, catalogs, arch specs to create a shareable knowledge base for all data assets of the company
- Hire, manage, coach and lead a team of Data Engineers
- In partnership with cross functional stakeholders, establish clear goals, requirements, solution paths and timelines for projects
- Collaborate with cross functional teams to deliver data driven features to the LeafLink platform
- Drive quality of execution and timely delivery of data engineering deliverables
- Enable members of the D&A organization by providing tools for easily deploying complex data tasks into production and simplifying workflows, modeling raw data in analysis friendly data structures, providing code reviews and intra team collaborative projects
- Own and maintain centralized git repository and tools used by the D&A team
- Partner closely with Analysts, BI Engineers and Data Scientists on projects like deployment of ML pipelines, data powered platform features, dashboarding and scaled experimentation
Qualifications
- A strong leader with proven experience leading, growing, and mentoring teams of engineers
- A passion for building and retaining teams of individuals that are highly motivated and excited about the work they’re contributing to
- Experience managing product and project process, resourcing, timelines, and delivery efforts with cross-functional teams
- Extensive experience leading and contributing to high-functional, large scale architecture
- Expertise and hands-on experience building a modern data stack using AWS especially s3 and Redshift
- Expertise in developing and maintaining relational database structures and relationships
- Experience monitoring and managing Redshift db Clusters
- Comfortable in diagramming and documenting processes, relational structures using tools like Visio, Lucidchart, Confluence
- Expertise writing processing jobs to ingest a variety of structured and unstructured data received from various sources & formats such as Rest APIs, Flat Files, Logs
- Expert level skills in using Python for data processing coupled with AWS offerings like Lambda, Fargate, Kubernetes
- Expert level skills in writing & managing optimized SQL for creating, updating and querying source of truth tables
- Hands-on experience with deployment using CI/CD, Docker; experience with ECS good to have
- Hands on experience to with DAG based workflow orchestration frameworks like dbt, Luigi, Airflow, AWS Pipeline
- Experienced in working within an integration environment with testers to ensure end to end performance and resilience can be achieved
- Well-versed in version control systems (Git)
- Experience working in a team with data scientists and analysts as clients is a plus
- Experience with platforming ML & using Spark is a plus but not required
- Comfortable working in a fast-paced growth business with many collaborators and quickly evolving business needs
Benefits
- Flexible PTO to give our employees a little extra R&R when they need it
- Competitive compensation and 401k
- Comprehensive health coverage (medical, dental, vision)
- Commuter Benefits through a Flexible Spending Account
- A robust stock option plan to give our employees a direct stake in LeafLink’s success
LeafLink’s employee-centric culture has earned us a coveted spot on BuiltInNYC’s Best Places to Work for in 2021 list. Learn more about LeafLink’s history and the path to our First Billion in Wholesale Cannabis Orders here.