SimilarWeb Logo

SimilarWeb

Data Engineer

Posted 8 Days Ago
Be an Early Applicant
Easy Apply
In-Office
Tel Aviv-Yafo
Senior level
Easy Apply
In-Office
Tel Aviv-Yafo
Senior level
Design and manage data ingestion pipelines, develop high-scale ingestion services, ensure system availability and data quality, and lead team decisions at Similarweb.
The summary above was generated by AI

At Similarweb, we're revolutionizing the way businesses interact with the digital world by revealing to them everything that happens online. Our cutting-edge platform and unique data empower over 4,300 customers globally, including industry giants like Google, eBay, and Adidas, to make game-changing decisions that drive their digital strategies.

In 2021, we went public on the New York Stock Exchange, and we haven’t stopped growing since!  

We’re looking for a Senior Data Engineer in the Data Collection Ingest team to contribute to the design and coding of Similarweb’s data ingestion services & pipelines. This role involves working as part of a team that handles millions of requests per minute across multiple servers, and is responsible for a wide-range of data pipelines, processing billions of events each day.

Why is this role so important at Similarweb?

As the most trusted platform for measuring online behavior, millions of people rely on Similarweb’s insights daily as the ground truth for their knowledge of the digital world. Producing these insights requires large scale raw data to be ingested reliably in high scale to provide stable signals for analysis. As a Data Engineer you will have the opportunity to perform hands-on work and own Similarweb’s raw data ingestion pipeline end-to-end. Your work will have a direct impact on the quality and reliability of our data and the insights that our products are delivering to our customers. 

So, what will you be doing all day?

Your role as Data Engineer of the Ingest Data Collection team means your daily responsibilities may include:

  • Design, code and manage end-to-end Similarweb’s data ingestion pipelines, both online and offline.  
  • Take charge of developing & maintaining modern data infrastructure, while implementing best practices for building data pipelines.   
  • Be responsible for high-scale ingestion services, solving challenges of availability, reliability, and scalability.  
  • Run the production environment by monitoring availability and taking a holistic view of system health and data quality.  
  • Own data infrastructure features from design to production using industry best practices with focus on quality and delivery.  
  • Lead design & decision-making processes of the team.  
  • Solve diverse complex problems of scale, performance and business logic.  
  • Collaborate with product managers and other team leaders to plan, nurture, and implement an efficient and effective development process.  
  • Continuously learn and evaluate new technologies in the everlasting effort to perfect our products  
  • Perform code reviews, evaluate implementations, and provide feedback about potential improvements.  
  • Improve your skills, learn from and mentor top-notch engineers and enrich other team members.  
  • Have lots of fun!

This is the perfect job for someone who:

  • Has 5+ years of experience in developing code for big data infrastructure. Proficiency in technologies such as: Databricks, Spark, Airflow, Firehose, SQS, or other similar tools.  
  • Proven experience working with high scale on AWS or any other cloud provider. Experience in architecture and design of large-scale and high performance production systems.  
  • Comfortable taking challenges and learning new technologies.  
  • Excellent communication skills with the ability to provide constant dialog between teams.  
  • Ability to take business requirements and translate them to technical alternatives by performing risk management and evaluating tradeoffs.

*All Similarweb offices work in a hybrid model, so you can enjoy the flexibility of working from home with the benefits of building face to face connections with fellow Similarwebbers.*

Why you’ll love being a Similarwebber:

You’ll actually love the product you work with: Our customers aren’t our only raving fans. When we asked our employees why they chose to come work at Similarweb, 99% of them said “the product.” Imagine how exciting your job is when you get to work with the most powerful digital intelligence platform in the world.

You’ll find a home for your big ideas:  We encourage an open dialogue and empower employees to bring their ideas to the table. You’ll find the resources you need to take initiative and create meaningful change within the organization. 

We offer competitive perks & benefits: We take your well-being seriously, and offer competitive compensation packages to all employees. We also put a strong emphasis on community, with regular team outings and happy hours.

You can grow your career in any direction you choose: Interested in becoming a VP or want to transition into a different department? Whether it’s Career Week, personalized coaching, or our ongoing learning solutions, you’ll find all the tools and opportunities you need to develop your career right here.

Diversity isn’t just a buzzword: People want to work in a place where they can be themselves. We strive to create a workplace that is reflective of the communities we serve, where everyone is empowered to bring their full, authentic selves to work. We are committed to inclusivity across race, gender, ethnicity, culture, sexual orientation, age, religion, spirituality, identity and experience. We believe our culture of equality and mutual respect also helps us better understand and serve our customers in a world that is becoming more global, more diverse, and more digital every day.

We will handle your application and information related to your application in accordance with the Applicant Privacy Policy available here.

Top Skills

Airflow
Databricks
Firehose
Spark
Sqs
HQ

SimilarWeb New York, New York, USA Office

50 W 17th St, New York, NY, United States, 10011

Similar Jobs

Yesterday
Hybrid
Tel Aviv, ISR
Mid level
Mid level
AdTech • Big Data • Digital Media • Marketing Tech
As a Data Engineer, you'll optimize database performance, design data flows, and develop automation tools while working with large-scale data environments.
Top Skills: BashBigQueryCassandraElasticsearchGrafanaHbaseHdfsIcebergKafkaMySQLPerlPythonSparkVertica
7 Days Ago
In-Office
Tel Aviv, ISR
Mid level
Mid level
Gaming
You will build and scale data infrastructure, manage data lakes, and collaborate on data processing for products.
Top Skills: AirflowAWSBigQueryGCPKafkaPostgresPubsubPythonRedshiftSQL
7 Days Ago
Easy Apply
In-Office
Tel Aviv, ISR
Easy Apply
Mid level
Mid level
Information Technology • Software
As a Data Engineer, you'll build and scale data infrastructure, manage data pipelines, maintain data lakes, design schemas, and collaborate globally with engineers.
Top Skills: AirflowApache IcebergAWSBigQueryGCPKafkaPostgresPubsubPythonRedshiftSQL

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account