Design, build, and maintain ingestion and transformation pipelines for a knowledge-graph analytics platform. Profile and prepare structured and semi-structured source data, ensure data lineage and traceability, implement transformation logic for graph loading, collaborate with data scientists on graph modeling and entity resolution, improve pipeline reliability, and document ingestion patterns using version control and issue tracking.
About the Organization
Now is a great time to join Redhorse Corporation. We are a solution-driven company delivering data insights and technology solutions to customers with missions critical to U.S. national interests. We’re looking for thoughtful, skilled professionals who thrive as trusted partners building technology-agnostic solutions and want to apply their talents supporting customers with difficult and important mission sets.
About the Role
Redhorse transforms the way government uses data and technology. We are seeking a Data Engineer to support a cross-functional team building technology-enabled, mission-critical intelligence workflows. Most intelligence transformation technologies fail because they are disconnected from how analysts think and act under pressure—our team works to prevent that.
Working in close partnership with graph data scientists and other engineers, you will ensure our state-of-the-art analytic platform (GraphAware Hume) supports real-world operational tradecraft. This is not a role focused on producing intelligence products; it is a role focused on building the pipelines and systems that produce decision advantage. You will play a vital part in ensuring the analytics platform answers complex queries and results in a user experience that delights analysts and survives contact with reality.
Key Responsibilities
- Design, build, and maintain robust data ingestion and transformation pipelines that supply the knowledge graph analytics platform.
- Profile source data and assess structure, quality, completeness, and integration challenges.
- Implement complex transformation, normalization, and preparation logic required to load data into graph solutions.
- Support source-to-graph traceability and data lineage to ensure analytic transparency and rapid debugging.
- Collaborate with the Lead Data Scientist and engineering peers to align source data processing with graph modeling and entity resolution requirements.
- Continuously improve data quality handling and pipeline reliability to ensure high-availability of intelligence insights.
- Document ingestion patterns, transformation rules, and technical considerations to support enterprise scaling.
- Utilize Jira and GitLab to manage tasks and maintain version control across the development lifecycle.
Required Experience/Clearance
- 5+ years of relevant professional experience in data engineering or related technical roles.
- Demonstrated experience in ETL/ELT development and large-scale data integration.
- Proven ability to handle both structured and semi-structured data from multiple disparate source systems.
- Experience designing transformation logic that supports downstream analytics, graph loading, and operational traceability.
- Proficiency with scripting (e.g., Python), data processing frameworks, and production-minded engineering practices.
- Bachelor’s degree from an accredited institution in Computer Science, Engineering, Information Systems, Mathematics, or a related field.
Desired Experience
- Experience supporting analytics, graph platforms (like Neo4j), or complex investigative data environments.
- Familiarity with DataBricks or Apache Spark for large-scale data processing.
- Knowledge of GraphAware Hume or other knowledge graph orchestration tools.
- Experience with CI/CD pipelines and automated testing for data workflows.
- Active security clearance or the ability to undergo a background investigation for government-related work.
We encourage all candidates who meet the basic requirements to apply, even if you do not have any of the following experience:
The salary range provided for this position represents the anticipated base salary for successful candidates. Actual compensation will be determined based on a variety of factors, including relevant experience, education, certifications, skills, security clearance level, geographic location, market conditions, and internal equity. In addition to base salary, eligible employees may participate in Redhorse's comprehensive benefits programs and may be eligible for performance-based or other incentive compensation, where applicable.
Redhorse Corporation is an equal opportunity employer. All qualified applicants will receive consideration for employment and will not be discriminated against on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, veteran status, disability, or any other protected class.
If you are a qualified individual with a disability or a disabled veteran, you may request a reasonable accommodation if you are unable or limited in your ability to access job openings or apply for a job on this site as a result of your disability. You can request reasonable accommodations by contacting Talent Acquisition at [email protected]
Redhorse Corporation shall, in its discretion, modify or adjust the position to meet Redhorse’s changing needs. This job description is not a contract and may be adjusted as deemed appropriate in Redhorse’s sole discretion.
Similar Jobs
Information Technology
Lead technical delivery and governance for enterprise ServiceNow implementations, providing architecture, standards, training, risk escalation, stakeholder communication, and client advisory. Drive solution design for CSM and ITSM, mentor engineers, and ensure successful implementation across large-scale engagements.
Top Skills:
CsmItsmServicenow Certified Technical Architect (Cta)Servicenow Platform
Information Technology
Lead design and execution of enterprise AI enablement programs for customer-facing teams. Manage needs assessments, instructional design, program measurement, stakeholder engagement, vendor partnerships, and coach ID team members to drive AI adoption and business outcomes.
Top Skills:
Ai-Enabled Learning ToolsCollaboration PlatformsGenerative Ai ToolsMS Office
46 Minutes Ago
Artificial Intelligence • Fintech • Insurance • Marketing Tech • Software • Analytics
Lead data steward for Personal Lines Product, Pricing, and Underwriting domains. Define and maintain a data roadmap, translate plans into actionable epics, govern data policy and classification, and coordinate stakeholders to modernize systems (streaming, data vault, warehousing) and enable a unified insurance platform. Advise Agile squads and collaborate with technical teams to implement durable, compliant data solutions.
Top Skills:
Data VaultData WarehousingGuidewire PolicycenterHadoopKafkaNoSQL
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
