Twenty Logo

Twenty

Staff Data Engineer

Reposted 23 Days Ago
In-Office
New York, NY, USA
Senior level
In-Office
New York, NY, USA
Senior level
Lead the development and operation of a data lake for cyber operations, design schemas and indexes, build and evolve ETL pipelines, mentor engineers, and drive technical initiatives.
The summary above was generated by AI
About the Company

America is under sustained cyber attack. Our adversaries infiltrate our networks, steal our IP, and degrade the digital infrastructure that modern life runs on. They’ve learned—correctly—that those attacks rarely produce consequences.

Twenty was founded to change that, by making our adversaries think twice before they attack us. Our vision is American and allied primacy in cyberspace—a future where they cannot contest us, deterrence is assured, and the free world remains secure.

Founded in 2024, Twenty Technologies (www.twenty.io) industrializes offensive cyber operations for the U.S. and its allies. Headquartered in Arlington, Virginia, Twenty has raised $138M from Accel, Caffeinated Capital, Friends & Family Capital, Point72 Ventures, General Catalyst, and In-Q-Tel.

 
Role Summary

You will own the data infrastructure that powers Twenty’s cyber operations applications and capabilities. This role is about building a durable, high-performance data lake and the pipelines, schemas, and query patterns that make petabyte-scale datasets usable and economical. You’ll partner closely with engineers and intelligence analysts to turn messy, high-volume operational data into reliable, well-modeled systems that drive real missions. You’ll also lead technical initiatives and mentor other engineers as we scale what we can support and ship.

Who You Are
  • You think in systems: data modeling, storage formats, compute engines, and access patterns all have to fit together.

  • You’re opinionated about schema and index design, and you can explain tradeoffs clearly.

  • You default to measurable reliability: data quality, lineage, repeatability, and operational excellence.

  • You’re comfortable working with ambiguous datasets and evolving requirements without lowering standards.

  • You collaborate tightly across roles, especially with engineers and analysts who need fast, correct answers.

  • You take leadership seriously—mentoring others, raising the bar, and driving initiatives to completion.

  • You’re motivated by national security outcomes and want your work to matter in the real world.

What You’ll Do
  • Lead the development and operation of a data lake for cyber operations and intelligence data.

  • Design schemas, partitions, and indexes that make complex datasets performant and cost-effective to query.

  • Partner with engineers and intelligence analysts to define query patterns and data products for mission use cases.

  • Build and evolve ETL pipelines that are observable, recoverable, and resilient to upstream change.

  • Drive technical initiatives end-to-end, from architecture decisions through production rollout and iteration.

  • Establish best practices for data quality, documentation, and operational ownership across the platform.

  • Mentor engineers on data modeling, performance tuning, and production-grade pipeline design.

  • Identify bottlenecks in storage/compute/query layers and ship improvements with clear performance wins.

Must Have
  • You have 8+ years of experience in data engineering and/or data architecture.

  • You have mastery-level expertise building ETL pipelines and operating them in production.

  • You have deep experience with data lake architecture and systems used to query data lakes.

  • You have strong schema and index design skills, including partitioning, indexing, and clustering strategies.

  • You have experience with column-oriented databases in production environments.

  • You have built data systems from scratch (not only maintained existing platforms).

  • You have proven leadership experience mentoring engineers and driving technical initiatives.

  • You are a U.S. citizen and can meet the role’s security requirements.

Nice To Have
  • You have experience with key-value datastores.

  • You have worked with streaming and message queue systems.

  • You have experience with graph database technologies.

  • You have worked with internet/networking datasets (e.g., scan data, DNS, netflow, certificates).

  • You have experience supporting analysts or operational users with high-stakes data needs.

Tech Environment (You Might Work With)
  • Data lakes: Apache Iceberg, Delta Lake, Apache Hive

  • Query engines: Trino, Presto, AWS Athena, Apache Spark

  • Column stores: ClickHouse, Amazon Redshift, Google BigQuery

  • ETL / orchestration: Airflow, AWS Glue, NiFi, ClickPipe

  • Streaming / queues: Kafka, RabbitMQ, NATS, AWS Kinesis

  • Graph: Neo4j, AWS Neptune, Memgraph, Apache AGE

Benefits
What's on the table:

  • Health. Medical, dental, and vision plan options. Life / AD&D, disability coverage options.

  • Family. Paid parental leave for eligible full-time employees. 12 weeks for birthing parents, 4 for non-birthing parents, 6 weeks for adoptive, foster, or intended parents through surrogacy.

  • Vacation. Paid holidays and flexible PTO. Take what you need.

  • Retirement. 401(k) with pre-tax and Roth options. HSA/FSA options, dependent care FSA.

  • At the office. Commuter benefits. On-site garage parking. Bike storage. Building fitness center. Desk setup stipend.

Benefits vary by location, role, and eligibility. Full plan details provided during the interview and offer process.


If this role sounds like you, apply and share with us your interest.

Some positions may require eligibility to obtain a U.S. Government security clearance. Any clearance requirement will be listed in the role description.

Twenty is an equal opportunity employer. We consider all qualified applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, veteran status, disability, or any other protected status.

If you need a reasonable accommodation during the hiring process, let us know and we will work with you.

HQ

Twenty New York, New York, USA Office

New York, NY, United States

Similar Jobs

6 Days Ago
Easy Apply
In-Office or Remote
2 Locations
Easy Apply
Senior level
Senior level
Artificial Intelligence • Healthtech • Software • Telehealth
Build and own the companys modern data platform: ingestion, orchestration, Snowflake architecture, dbt transformations and CI/CD, observability, governance, and a semantic layer to enable trusted analytics and production AI/ML workloads. Partner cross-functionally and automate recurring operational pain points into reusable platform capabilities.
Top Skills: Ai/MlCi/CdDbtFivetranMetabaseOmniRudderstackSnowflakeSQL
14 Days Ago
Remote or Hybrid
United States
200K-260K Hourly
Senior level
200K-260K Hourly
Senior level
Big Data • Cloud • Productivity • Software • Database • Analytics • Automation
Own and architect large-scale data pipelines, orchestration, and integrations. Drive IaC strategy (Terraform), third-party API and AI/LLM tool integrations, build export pipelines and internal tooling, mentor engineers, and align cross-team technical strategy for reliable, scalable data infrastructure.
Top Skills: Apache AirflowCi/CdClaudeCloudFormationDagsterDelta LakeGitGithub CopilotGitlabJIRALakehousePrefectPythonRest ApisTerraform
2 Days Ago
Hybrid
New York, NY, USA
212K-265K Annually
Expert/Leader
212K-265K Annually
Expert/Leader
Consumer Web • Healthtech • Professional Services • Social Impact • Software
Lead architecture and delivery of scalable data infrastructure: design and optimize ETL/ELT pipelines, enterprise data models, and data quality frameworks. Define platform standards, mentor engineers, drive cross-functional initiatives, and partner with analytics, data science, and engineering stakeholders to ensure reliable, production-grade data assets.
Top Skills: Apache AirflowData ModelingData Quality FrameworksDbtEtl/EltPythonSnowflake

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account