Data Engineering Technical Lead / Manager
Since our inception in 2009, Foursquare has been a leading force in changing how location information enriches our real-world and digital lives. As a location intelligence company, Foursquare is comprised of our thriving media and enterprise products, as well as two well-known consumer apps—Foursquare and Swarm. Our B2B offerings include the Pilgrim SDK, Places (for developers), Pinpoint and Attribution (for marketers), and Place Insights (for analysts, based on the world's largest foot traffic panel). With more than 200 people across our offices in New York, San Francisco, Chicago, and in sales offices around the globe, we’re dedicated to our trailblazing mission—enriching consumer experiences and informing business decisions with location intelligence.
About this Position:
As the Foursquare Visit Data Engineering team lead, you would lead and manage a small team of talented data engineers. The team works on the visit data MR pipeline that drives our B2B products, including attribution products, SaaS analytics, and other data offerings. The pipeline team is a part of Pilgrim, the engineering and data science department responsible for all aspects of visit data at Foursquare and the SDK that powers our foot-traffic panel and a variety of applications around the world.
In this role, you would act as a hands-on technical lead and manager for a team of 3-4 engineers, driving technical and architectural planning as well as contributing as a developer and interacting with data scientists and analysts. The role includes engineering, statistics, project management, architectural design and people management. The pipeline team owns the processing of the visit data that flows into our product lines and also the normalization and sanitization of the data, including the preservation of longitudinal consistency for a variety of use cases.
Relevant technology experience includes Amazon EMR, Hadoop, comfort with Scala and Scalding, and ideally familiarity with Luigi and Hive. As a leader on this team, you would collaborate with other members of the Pilgrim org, including the data scientists and machine learning engineers who build our visitation models and analysts who support our products. You would work directly with product managers for our attribution products and our SaaS products to cater the design of the data pipeline to our growing product needs. We are facing significant growth in the scale of our products and the data we ingest every day. In this role, you would have significant ownership over the direction we take in expanding our data pipeline and in improvements to our methodologies for sanitizing, scaling and normalizing this data.
This role is open for hire in our New York City headquarters.
- Degree in Computer Science, Computer Engineering, or Statistics or commensurate experience
- 6-8+ years of software engineering and/or management experience
- Proven track record of building and shipping large-scale engineering products and/or infrastructure
- Experience working with large, complex data sets from a variety of sources
- Ability to collaborate with a diverse set of engineers, data scientists and product managers
- Experience with functional and object-oriented programming, Scala a plus
- Experience with Hadoop and Scalding or Spark, EMR and Luigi nice to have
- Effective communication skills (both written and verbal)
- Comfort in a fast-paced startup environment
Foursquare is proud to foster an inclusive environment that is free from discrimination. We strongly believe in order to build the best products, we need a diversity of perspectives and backgrounds. This leads to a more delightful experience for our users and team members. We value listening to every voice and we encourage everyone to come be a part of building a company and products we love.
Foursquare is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, protected Veteran status, or any other characteristic protected by law.