Aaru Logo

Aaru

Data Engineer, Infrastructure

Reposted 2 Months Ago
In-Office
New York, NY, USA
Mid level
In-Office
New York, NY, USA
Mid level
Build and maintain scalable pipelines to ingest, clean, and integrate large multimodal datasets. Own ingestion across APIs, files, cloud storage, and warehouses. Design linkage, entity resolution, deduplication, and schema harmonization. Implement data quality checks, validation, and documentation. Collaborate with engineering, research, and deployment teams to prepare integrated data for simulations and evaluate new data sources.
The summary above was generated by AI
ABOUT AARU

Aaru operates at the frontier of predictive intelligence, using AI to simulate and predict human behavior at scale. By generating and deploying instances of artificial intelligence that mirror humans, called agents, Aaru simulates entire populations with unprecedented accuracy. Our partners use Aaru to refine strategic positioning, identify and understand high-value audiences, validate concepts and messaging before launch, optimize pricing decisions, and build a continuously richer understanding of their customers through simulation. We provide organizations with invaluable foresight, empowering them to anticipate outcomes and proactively make the right decisions at the right time, every time.

We're a small, dedicated, mission-driven team and we intend to stay that way. We believe the best work happens when exceptionally talented people are given ownership, trust and the space to operate without bureaucratic friction. We work with urgency and intellectual honesty and expect new team members to match our velocity. We seek individuals who thrive at the frontier, who push beyond conventional limits, who bring curiosity and conviction in equal measure, and who want their work to have demonstrable impact in the world. If you're energized by the idea of a small team doing things that feel impossible, let’s build together.

ABOUT THE ROLE

As a Data Engineer on the Infrastructure team, you will build and maintain the data foundation that powers Aaru’s simulations. You will work across large internal and third-party datasets, designing reliable integration workflows, and ensuring that data can be linked, queried, and trusted at scale. This role sits at the intersection of data engineering and architecture and is critical to how Aaru produces predictive intelligence.

RESPONSIBILITIES
  • Build and maintain scalable pipelines to ingest, clean, and integrate large multimodal datasets

  • Own data ingestion across APIs, flat files, cloud storage, and data warehouses

  • Design workflows for linkage, entity resolution, deduplication, and schema harmonization across imperfect or incongruent datasets

  • Work with engineering, research, and deployment teams to make integrated data usable for simulation ingestion

  • Establish and monitor data quality checks, validation logic, and documentation across datasets and pipelines

  • Help evaluate new data sources and determine how they can be joined with existing data assets

YOU MAY BE A FIT IF
  • You have 3+ years of experience in data integration, data engineering, ETL/ELT, or a similar role involving large-scale datasets

  • You have hands-on experience working with messy, high-volume data (>100 TB) and know how to build systems that remain reliable at scale

  • You are highly fluent in SQL and Python, and comfortable working across modern data infrastructure such as Snowflake, BigQuery, Databricks, or similar tools

  • You have strong judgment around data quality and know how to preemptively identify inconsistencies, edge cases, and integration risks

STRONG CANDIDATES MAY ALSO
  • Have experience with alternative data, (transaction data, clickstream, geospatial, etc) either from a hedge fund or data marketplace lens

  • Have experience building matching or entity-resolution systems across fragmented or noisy identifiers

  • Have familiarity with privacy, compliance, and data licensing considerations when working with sensitive or third-party data

  • Have worked closely with researcher or product teams to turn raw data from disjoint sources into accessible structured database

  • Have a background in statistics and familiarity with sampling biases, bot-detection, imputation, and standard data quality metrics

LOCATION

This role is based in New York City. Aaru is an in-person company, working 5 days a week in office. Candidates are expected to be located within the New York City metropolitan area or open to relocation.

BENEFITS

At Aaru, we take care of our people. In addition to a competitive base salary and equity participation, we offer comprehensive medical, vision, and dental coverage, visa sponsorship and relocation support, and various other benefits and perks.

Similar Jobs

11 Days Ago
In-Office
New York, NY, USA
229K-364K Annually
Senior level
229K-364K Annually
Senior level
Information Technology • Internet of Things
Build and operate scalable data infrastructure for personalized recommendations and music discovery. Responsibilities include streaming and batch pipelines, feature computation and serving, event logging, workflow orchestration, observability, data quality, and infrastructure as code across AWS and Snowflake. The role owns architecture and reliability, partners with ML, data, and product teams, leads technical design, and mentors engineers.
Top Skills: AirflowAWSDagsterDbtFirehoseFlinkGlueKafkaKinesisLambdaPythonS3SnowflakeTerraform
14 Days Ago
In-Office
New York, NY, USA
150K-200K Annually
Mid level
150K-200K Annually
Mid level
Machine Learning • Business Intelligence
Design and build high-throughput, low-latency market data infrastructure in modern C++ for global equities, futures, and options venues. Develop reusable libraries for market data decoding, normalization, publishing, and consumption; collaborate with quantitative researchers; troubleshoot production issues; and maintain reliable 24/7 systems. The role requires strong concurrency, lock-free algorithm, memory-model, compiler optimization, serialization, and Python scripting expertise.
Top Skills: C++FastIn-Memory CachesProtocol BuffersPythonSbeTime-Series Databases
22 Days Ago
In-Office or Remote
New York, NY, USA
177K-365K Annually
Expert/Leader
177K-365K Annually
Expert/Leader
Social Media
Leads the design and delivery of scalable infrastructure data systems, including ingestion pipelines, transformations, data models, and services for usage, cost, ownership, and planning. Establishes technical direction, data contracts, quality controls, monitoring, and operational processes while leading cross-functional initiatives and mentoring engineers. Uses AI responsibly to improve development and data-quality workflows while validating outputs and protecting sensitive information.
Top Skills: AWSDbtPythonSQL

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account