Data Engineering Manager / Lead

| Remote
Apply now
By clicking continue you agree to Built In’s Privacy Policy and Terms of Use.
About Knotch
As the global leader in Content Intelligence, Knotch’s mission is to empower brands to unlock the true value of their content by using data-driven strategies. With the Knotch Content Intelligence Platform, companies conduct competitive research and measure the performance of their content in real-time. Through our unique ability to provide a 360-degree view of all your content, including paid and owned, Knotch allows companies to connect content to business outcomes to enhance brand, increase ROI and build audiences.

We’re proud of our team
We’ve been building our products since 2013, and our team has grown in size and in spirit. We’ve been humbly recognized in the top 12% of fastest growing companies in America by Inc! Since the Covid-19 pandemic we’ve become remote-first, and we plan to stay that way. We know that a flexible environment leads to a happy team as we’ve again been named a Best Place to Work four years running by Built In NYC and a NYC company with Best Perks + Benefits in 2021! If you’d like to speak with our recruiting team about the future of Knotch, feel free to connect with us on LinkedIn and learn about us further on our careers site.

Lead Data Engineer - Full Time Permanent Employee - 100% Remote - HQ NYC, NY, United States
Our Data Engineering team is focused on large-scale data projects, integrating numerous sources with our real-time streaming analytics platform. Knotch’s product integrates data from various sources around the internet. To take our data practices to the next level, we’re looking for a Data Engineering Lead/Manager to come on board and manage our entire Data Engineering department! If you joined, you would manage the engineers themselves and help guide them to fully realizing Knotch’s content intelligence platform through ETL/ELT processes and state-of-the-art Spark transformations. Knotch’s data products rely on the work from this team, so you’ll be helping the company’s MarTech products operate at their true potential.

As a senior data engineer / lead, you will work closely with your data engineers and related engineering/product teams and report directly to our Data Architect, Shane Jiang.

How you’ll add value at Knotch:

  • Design, build and launch new ETL/ELT processes that transform raw data into a format usable by downstream applications that serve both analytical and operational use cases
  • Perform code review, provide valuable and actionable feedback to peers
  • Ensure on-time delivery of data pipeline solutions that meet Knotch’s product needs
  • Design and execute data pipeline projects in conjunction with Data Architect and other engineering function leaders
  • Coach, manage, and mentor your team to learn and grow into future engineering leaders
  • Foster a culture of “what is possible” than “why is it not possible,” building trust with your peers and motivating them to be creative and thoughtful in their approach

You’ll be successful here if you:

  • Have 5+ years of Data Engineering experience, with at least one (1) year of leadership experience
  • Bring excellent knowledge on SQL, relational databases, and data modeling
  • Deeply understand custom ETL/ELT design, implementation, and maintenance
  • Have hands-on experience managing an AWS environment utilizing server-less event-driven services
  • Are highly proficient in Python and Apache Spark
  • Are familiar with Apache Airflow
  • Possess knowledge of AWS cloud services, including Lambda, Redshift, EKS and SNQ/SQS, etc.
  • Have a demonstrated track record as a leader to be able to manage deliverables, hold team members accountable, and bring projects through deployment
  • Have an innate passion for technology, learning, sharing, and finding the best solutions

We also appreciate (but don’t require):

  • Business Intelligence experience and Superset
  • Proficiency with Grafana, Loki & Prometheus stack experience
  • Data science experience; creating algorithms or working closely with data scientists on engineering teams

Knotch is an equal opportunity employer. We strive to provide equal opportunities in all of our processes, including our hiring and employee experience.

We pride ourselves on our three values: transparency, relentlessness, and inclusiveness.
We commit to daily work towards leading with empathy, reducing bias through periodic training, and engaging with and uplifting communities of marginalized groups.

We condemn all forms of racism and discrimination on the basis of race, religion, ethnicity, nationality, gender identity, sexual orientation, age, marital status, pregnancy or parenthood status, veteran status, disability status or any other identifier.

We encourage all employees, clients, investors, candidates, vendors, and friends of Knotch to deliver honest feedback directly or anonymously so that we may always seek to improve as an organization that is dedicated to diversity, equity, inclusion, and belonging.

Share your thoughts with us, and you will be heard.


Read Full Job Description
Apply now
By clicking continue you agree to Built In’s Privacy Policy and Terms of Use.

Technology we use

  • Engineering
  • Product
  • Sales & Marketing
    • AWS (Amazon Web Services)Languages
    • JavascriptLanguages
    • PythonLanguages
    • RLanguages
    • RubyLanguages
    • SqlLanguages
    • D3JSLibraries
    • ReactLibraries
    • ReduxLibraries
    • ChartJSLibraries
    • RechartsLibraries
    • SequelLibraries
    • Active RecordLibraries
    • Ruby on RailsFrameworks
    • SparkFrameworks
    • Apache AirFlowFrameworks
    • AWS LambdaFrameworks
    • PostgreSQLDatabases
    • RedshiftDatabases
    • KnotchAnalytics
    • InVisionDesign
    • SketchDesign
    • FigmaDesign
    • ConfluenceManagement
    • JIRAManagement
    • Monday.comManagement
    • WordpressCMS
    • WebflowCMS
    • SalesforceCRM
    • PardotCRM
    • PardotEmail
    • PardotLead Gen
    • DriftLead Gen


Knotch is remote 1st but if you prefer to venture in to the city, we're headquartered in Tribeca NYC. Surrounded by some of the finest eateries and most diverse neightborhoods in the US. We're also accessible by most forms of public transportation no matter what direction you're coming from.

An Insider's view of Knotch

How would you describe the company’s work-life balance?

We are a remote 1st company that values each individual's ability to balance the requirements of work and life as they see fit. We believe that we have the right people to do the work when and where it works best for them. We also encourage our teams to take at least 1 hour of personal time each day (in addition to lunch) for self-care.


Senior Vice President of Legal and HR Affairs

How do you collaborate with other teams in the company?

We face new problems everyday but there is an incredible support system here and everyone works collaboratively towards the best solution. We are united by a common vision and transparent in every aspect of our operations, which is so rare to find.


Vice President of Finance

How has your career grown since starting at the company?

Knotch's commitment to my personal growth has played a huge role in shaping my career. I've found that I'm happiest when collaborating with others and was encouraged to join the product team to work more closely across all of our teams. Knotch's L&D program has set me on a path that makes my work more fulfilling, pushing me to be better every day.


Project Manager, Product

How do you empower your team to be more creative?

On our revenue team, we foster an environment where everyone can feel it's safe to question things, and we celebrate them when they speak up and bring new ideas to the table.


Vice President of Business Operations

How does the company support your career growth?

Knotch has been a support system that encourages, challenges, and cares for my career. I have been able to start new roles within the Revenue and now HR team and the support comes from the top to the bottom.

Margeaux Welsh

Senior HR Consultant

What are Knotch Perks + Benefits

Knotch Benefits Overview

You may work from wherever, whenever.
You are encouraged to take time off when you need it and expected to really disconnect.
You can give feedback and receive it in real-time.
You are encouraged to talk openly about mental health + more.
Leadership is readily available to lend a hand and answer questions.
You get to hangout (IRL or virtually) with people you are excited to work with everyday.
Access to excellent medical, dental, and vision plans at low cost to you
We offer a monthly reimbursement toward mental health wellness, professional development and healthy eating.
We gift you & your family a One Medical membership (where applicable.)
We supply you with a laptop and tools you need to get your work done
We guarantee you 12+ paid holidays and unlimited time off.
We offer an employee assistance program at no cost to our employees.

Volunteer in local community
Partners with Nonprofits
Friends outside of work
Eat lunch together
Intracompany committees
Daily sync
Open door policy
Team owned deliverables
Team based strategic planning
Group brainstorming sessions
Pair programming
Open office floor plan
Documented equal pay policy
Highly diverse management team
Knotch is a M/WBE company and we always put people first.
Unconscious bias training
In 2020, we held internal Unconscious Bias trainings and Inclusive Practices trainings through LifeLabs. Sentiment was so high that we now have a recurring training model.
Diversity manifesto
Mean gender pay gap below 10%
Diversity Employee Resource Groups
Current ERGs at Knotch include but aren't limited to: 1. Ladies of Knotch 2. BIPOC (Black, Indigenous and People of Color) at Knotch 3. LGBTQ+ at Knotch 4. Engineer Culture Committee 5. Culture C
Hiring Practices that Promote Diversity
We push to seek talent through diverse sourcing and use Lever to collect optional EEOC and Diversity Survey responses so that we can benchmark and exceed our own equal hiring initiatives.
Health Insurance & Wellness Benefits
Flexible Spending Account (FSA)
Knotch offers a wellbeing and lifestyle benefits platform through which all full-time employees are reimbursed for elected expenses on a monthly basis.
Disability Insurance
Dental Benefits
Vision Benefits
Health Insurance Benefits
Life Insurance
Pet Insurance
Wellness Programs
Mental Health Benefits
Retirement & Stock Options Benefits
Company Equity
Employee Stock Purchase Plan
Performance Bonus
Match charitable contributions
In the past, we've matched charitable contributions, most recently to The Center which offers LGBTQ communities of NYC advocacy, health and wellness programs and more. This year's no different.
Child Care & Parental Leave Benefits
Child Care Benefits
Generous Parental Leave
We provide up to 12 weeks of parental leave for the primary caretaker. Knotch also provides 12 weeks of leave for the secondary caretaker.
Flexible Work Schedule
Remote Work Program
While our offices are headquartered in NYC and offer all of the amenities anyone could hope for, all employees at Knotch my opt-in to work remotely anywhere throughout the US.
Family Medical Leave
Restricted work hours
Return-to-work program post parental leave
Company sponsored family events
Vacation & Time Off Benefits
Unlimited Vacation Policy
Generous PTO
Paid Volunteer Time
Paid Holidays
Paid Sick Days
Perks & Discounts
Casual Dress
Commuter Benefits
Company Outings
We have NYC-based events monthly and we also have two offsites per year where we fly the entire company to an exciting locale for team building and educational opportunity!
Stocked Kitchen
Knotch's employees who do opt-in to work onsite are always welcome to. Our NYC kitchen is stocked with all the coffee, snacks, drinks, and Emergen-C you'll ever need.
Some Meals Provided
Happy Hours
Pet Friendly
Recreational Clubs
Fitness Subsidies
Home Office Stipend for Remote Employees
Professional Development Benefits
Job Training & Conferences
Diversity Program
Lunch and learns
Knotch hosts lunch and learn meetings anytime we have something awesome to share with the team. We also do a Show & Tell every Friday that complements these.
Cross functional training encouraged
Promote from within
Continuing Education stipend
We offer $1000 annualy for continuing education related to your role at Knotch (starts after 6 months of working with us)
Time allotted for learning
Online course subscriptions available
Customized development tracks
Paid industry certifications

Additional Perks + Benefits

We create our initiatives for our employees. They aren't a recruitment tool for us but rather a way for us to truly appreciate the hours and effort our employees put in every single day and to make their lives a little easier and a little better. You spend a lot of time at work- you might as well enjoy it.

More Jobs at Knotch9 open jobs
All Jobs
Data + Analytics
Apply now
By clicking continue you agree to Built In’s Privacy Policy and Terms of Use.
Save jobView Knotch's full profileSee more Knotch jobs