Lead the Retrieval Ingestion Team by designing high throughput ingestion pipelines, mentoring team members, and ensuring optimal data indexing and retrieval.
Posting Type
Hybrid
Job Overview
We are seeking a Lead Software Engineer to join the Retrieval Ingestion Team at Relativity. This role is ideal for an experienced engineer who thrives on designing and operating high throughput ingestion pipelines that transform raw documents into search-ready indexes at scale.As the technical lead for the Retrieval Ingestion Team, you will own the ingestion lifecycle—from content acquisition and normalization through indexing, enrichment, and monitoring. You will guide the team in building fault-tolerant, low-latency systems that keep billions of documents discoverable and searchable in real time. You will balance hands-on technical contributions with leadership responsibilities, mentoring engineers on the team, shaping best practices for distributed ingestion, and ensuring alignment with platform-wide retrieval and search goals.
Job Description and Requirements
Key Responsibilities- Lead the Retrieval Ingestion Team, providing technical direction, mentoring, and coordination across projects.
- Architect and maintain scalable ingestion pipelines that handle billions of documents reliably and efficiently.
- Drive adoption of event-driven and micro-batch ingestion frameworks using Kafka, Kinesis, or Flink.
- Collaborate with retrieval engineers to ensure ingested data is optimized for indexing and retrieval performance (sharding, metadata enrichment, incremental updates).
- Establish SLAs and monitoring for ingestion throughput, latency, data completeness, and recovery.
- Partner with platform, security, and compliance teams to ensure ingestion pipelines handle sensitive legal data securely and meet enterprise standards.
- Champion best practices in CI/CD, observability, automated testing, and operational readiness for ingestion systems.
- Contribute to innovation by incorporating vector indexing, knowledge graph enrichment, and AI-driven pipelines into the ingestion workflow.
- 6+ years of professional software engineering experience, including 2+ years in a lead role.
- Proven expertise in building distributed ingestion or ETL systems for search or largescale data platforms.
- Deep knowledge of indexing/search systems (Elasticsearch, Lucene, Solr, Vespa, or OpenSearch).
- Strong programming skills in C#, Java, Python, or Go, with emphasis on reliability and performance.
- Familiarity with schema evolution, metadata modeling, and handling semi/unstructured data for indexing.
- Hands-on experience with Kubernetes, containerization, and CI/CD pipelines in cloud environments (Azure, AWS, or GCP).
- Strong background in observability and operational resilience for ingestion systems.
- Experience integrating embeddings and vector databases into ingestion workflows.
- Familiarity with knowledge graph enrichment for entity and relationship extraction during ingestion.
- Background in compliance-heavy domains such as legal, finance, or healthcare.
- Experience with change data capture (CDC) and event sourcing patterns.
- Contributions to open-source ingestion, indexing, or retrieval frameworks.
Why Join Us?
- Lead the Retrieval Ingestion Team, driving how documents flow into Relativity’s next generation search platform.
- Operate at the core of retrieval, distributed systems, and AI, ensuring billions of documents are indexed securely and efficiently.
- Mentor engineers and shape best practices for ingestion and indexing across the organization.
- Join a cloud-native engineering culture investing in scalable, AI-enabled retrieval systems that transform how legal data is discovered.
Relativity is committed to competitive, fair, and equitable compensation practices.
This position is eligible for total compensation which includes a competitive base salary, an annual performance bonus, and long-term incentives.
The expected salary range for this role is between following values:
$150,000 and $224,000The final offered salary will be based on several factors, including but not limited to the candidate's depth of experience, skill set, qualifications, and internal pay equity. Hiring at the top end of the range would not be typical, to allow for future meaningful salary growth in this position.
Top Skills
AWS
Azure
C#
Elasticsearch
Flink
GCP
Go
Java
Kafka
Kinesis
Kubernetes
Lucene
Opensearch
Python
Solr
Vespa
Similar Jobs
Healthtech • Insurance
The Lead FHIR Software Engineer coordinates complex technical initiatives, manages delivery teams, ensures SDLC standards, and mentors team members for enhancing business solutions.
Top Skills:
Aws Api GatewayAws CdkAws CloudwatchAws DynamodbAws GlueAws LambdaAws S3Aws SnsAws SqsOauthRest Api ServicesTypescript
Legal Tech • Software
Design, develop, and support PII detection solutions, lead technical design and product improvements, and guide the engineering team while ensuring quality and customer empathy.
Top Skills:
Azure DevopsC#ElasticsearchGitGitlabJavaJenkinsKubernetesLinuxMongoDBPythonRedis
Fintech • Financial Services
The Commercial Collections Representative will manage a portfolio of complex delinquent loans, ensuring compliance and providing training, while assisting customers effectively.
Top Skills:
ExcelMS OfficeOutlookWord
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory


