Cogent Security Logo

Cogent Security

Software Engineer - Data Platform (Staff+)

Posted 2 Months Ago
Hybrid
New York, NY, USA
100K-300K Annually
Senior level
Hybrid
New York, NY, USA
100K-300K Annually
Senior level
Design and implement a scalable data platform and integration pipeline to ingest, normalize, and index enterprise data. Build connectors, ETL/streaming pipelines, and storage/indexing strategies to support semantic search and GenAI use cases. Partner with applied AI teams, make build-vs-buy decisions, and create reusable patterns to scale integrations.
The summary above was generated by AI
About Cogent

Cogent is an Applied AI Lab building the next generation of AI agents for cybersecurity. AI has fundamentally changed how attacks happen, allowing malicious actors to operate at unprecedented speed and scale. Cogent’s "AI Taskforce" assesses petabytes of enterprise data to remediate these issues before critical breaches occur.

 

To stay at the cutting edge, we blend frontier research with real-world execution. Alongside our core product work, Cogent Research serves as our applied AI lab, providing the research horsepower needed to make truly agentic security workflows a reality.

 

Since coming out of stealth, Cogent has experienced rapid growth. We partner with Fortune 500 companies to secure some of the most complex production environments in the world.

 

We’re backed by Greylock and we’ve built a team with the best minds in applied AI. Our team is comprised of people from:

  • Top universities like Stanford, Berkeley, Penn, Duke, Carnegie Mellon, Waterloo

  • Unicorn, high-growth companies like Scale AI, Databricks, Stripe, Tesla, Coinbase

  • World class cybersecurity experts from Wiz, Abnormal AI, Zscaler

  • Preeminent research labs like Deepmind and SAIL

About the Role

We are looking for Founding and Staff-level Engineers to design and implement the foundational pillars of Cogent’s data platform and integration pipeline in order to reliably ingest and normalize enterprise data sources across many corporate and IT systems and then to enable the transformation of that data into a knowledge base that can be leveraged by other GenAI systems.

What You’ll Do & Achieve
  • Build the new standard for ingesting and extracting enterprise data

    • Your role will involve building data connectors, running data pipelines, and extracting insights and context from our customer’s enterprise environments. 

    • You should get excited about building robust and secure backend systems that handle large volumes of data, ETLs, as well as reimagining how enterprise security teams should extract, store and access data.

  • Design highly performant data pipelines and indexing strategies that enable Applied AI use cases like semantic search and retrieval augmented generation

    • Work with Applied AI teams to taxonomize, correlate and deduplicate data across various enterprise sources, and architect indexing, storage and query strategies for data in Cogent’s data lake.

  • Architect the modern data platform for Gen AI

    • The LLM stack and Gen AI landscape is changing everyday. You’ll be front and center of making build vs buy decisions for various tools and services needed by the data platform, and integrating these decisions into our broader architecture and tech roadmap. 

    • Implement generalizable design patterns and system components that allow us to scale from 1 integration to thousands of integrations

What You’ll Bring
  • 5+ years of professional experience as a hands-on engineer and technical leader leading multiple projects

  • Experience building data pipelines for Information Retrieval Systems (such as knowledge graphs, search engines, or similar) for enterprise use cases

  • Experience in ETL orchestration and workflow management tools (such as Temporal, Airflow) as well as building batch processing and streaming systems with tools like Apache Kafka/Flink

  • Expert in database fundamentals, SQL, data reliability practices and distributed computing

  • Experience working fluently with standard orchestration & deployment technologies like Kubernetes, Terraform, Docker, Databricks, etc in multiple clouds

For California Based Applicants

The standard base salary range for this position is $100,000 - $300,000 annually. Compensation offered will be determined by factors such as location, job level, job-related knowledge, skills, and experience. Certain roles may be eligible for variable compensation, equity, and benefits.

We are committed to building an inclusive and diverse company. We do not discriminate based on gender, ethnicity, sexual orientation, religion, civil or family status, age, disability, or race.

Similar Jobs

7 Days Ago
In-Office
New York, NY, USA
197K-401K Annually
Senior level
197K-401K Annually
Senior level
Cloud • Software
Build and lead Slack’s agentic analytics data platform, spanning ingestion, infrastructure, semantic layers, APIs, and developer tools. Drive systems from prototypes through production, balancing freshness, accuracy, reliability, and cost. Partner across data engineering, data science, infrastructure, product, and developer experience teams. Lead complex technical initiatives, improve architecture and adoption, mentor engineers, and establish reliable tools for analytics, query generation, root cause analysis, and AI-agent data access.
Top Skills: AirflowAPIsAWSDatabricksDatahubDbtGoHiveIcebergJavaKafkaMcpPinotPythonS3ScalaSdksSnowflakeSparkSQLSqlmeshSupersetTerraformTrinoTypescript
12 Days Ago
In-Office
New York, NY, USA
166K-308K Annually
Senior level
166K-308K Annually
Senior level
Cloud • Information Technology • Internet of Things • Professional Services • Software
Lead the architecture, scalability, reliability, performance, and cost efficiency of Cisco’s data platform. Define multi-quarter technical direction for storage, streaming, compute, observability, and performance tooling. Establish standards for schemas, migrations, SLOs, tenancy, retention, and capacity planning; lead major distributed-systems initiatives and production investigations; make technology and cost decisions; and mentor engineers across teams.
Top Skills: AWSBigQueryC++CeleryClickhouseDruidFlinkGCPGoJavaKafkaKinesisKubernetesMySQLOpentelemetryPostgresPrestoPulsarPyroscopePythonRabbitMQRisingwaveRustSnowflakeSpark StreamingTemporalTrino
23 Days Ago
Remote or Hybrid
USA
100K-300K Annually
Expert/Leader
100K-300K Annually
Expert/Leader
Hardware • Information Technology
Lead development of Hercules's AI-focused platform-as-a-service, including its database-like object model, backend services, APIs, SDKs, hosting infrastructure, and distributed systems. Build reliable, scalable, multi-tenant services with strong isolation, observability, resilience, low latency, and high throughput. Apply advanced Rust, data systems, architecture, API design, performance optimization, and AI-assisted development skills.
Top Skills: Ai SdkAnthropicAWSAws CdkClickhouseCloudflareDockerDrizzle OrmGoogle Ai ModelsHonoOpenaiOpentelemetryPostgresReactRedisRustTailwindTemporalTerraformTypescript

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account