Seeking a Senior Data Engineer for developing trade lifecycle data solutions, building cloud-native pipelines, and onboarding complex financial data sources.
PLEASE NOTE:
- It is a remote position.
- Looking for candidates in the NY/NJ area or the very
least on the East Coast.
- Duration: Contract through June 2027.
Job Description:
We are seeking a Senior Data Engineer with extensive Capital Markets
experience to support the design, development, and implementation of trade
lifecycle data solutions. The consultant will be responsible for building cloud-native
data pipelines, onboarding complex financial data sources, and supporting a
unified trade architecture that enables trade processing, reconciliation,
settlement, and exception management functions.
This role requires strong technical expertise combined with deep
knowledge of post-trade processing, DTCC platforms, and financial messaging
standards.
Requirements
Required Skills & Experience:
- 10+ years of Data Engineering experience within Capital Markets
environments.
- Strong Experience developing ETL pipelines using .NET application code
and deploying solutions into containerized Kubernetes environments.
- Strong experience writing.NET applications utilizing RabbitMQ libraries
for message queue integration and event-driven processing.
- Strong understanding of the complete trade lifecycle, including
execution, clearing, settlement, and reconciliation.
- Extensive experience designing and implementing ETL/ELT data pipelines.
- Strong expertise in data modeling, schema design, and transaction data
architecture.
- Hands-on experience with DTCC platforms, specifically RTTM and Settlement
Web.
- Strong knowledge of ISO 15022 financial messaging standards.
- Experience developing ingestion frameworks utilizing MQ technologies (IBM
MQ, RabbitMQ, Kafka, or similar) and REST APIs.
- Advanced SQL Server expertise including performance tuning, indexing,
query optimization, and stored procedure development.
- Strong experience with AWS cloud-native services, including S3, EKS,
Kubernetes, Docker, and RDS.
- Excellent troubleshooting, analytical, and problem-solving capabilities.
Preferred Experience:
- Unified Trade Record (UTR) schema design and implementation.
- Trade Exceptions platform development and support.
- Real-time or near real-time data processing architectures.
- Data governance, lineage, cataloging, and observability tooling.
- Regulatory reporting and compliance data requirements within Capital
Markets.
- FIX protocol message processing.
- FxML message processing.
- Previous consulting or client-facing delivery experience.
Similar Jobs
Big Data • Cloud • Productivity • Software • Database • Analytics • Automation
As a Senior Data Engineer at Jellyfish, you'll build and maintain data pipelines, optimize orchestration, automate CI/CD processes, and enhance data integration while ensuring high performance and reliability.
Top Skills:
AirflowBigQueryDagsterDatabricksDbtPrefectPysparkPythonRedisSnowflakeSQLTerraform
Healthtech • Information Technology • Software • Telehealth
The role involves architecting and improving data systems, defining governance standards, optimizing performance, and mentoring engineers in data engineering.
Top Skills:
AirflowBigQueryDagsterDbtPythonRedshiftSnowflakeSQL
Digital Media • Fintech • Information Technology • Machine Learning • Financial Services • Cybersecurity • Automation
Design, build, and maintain scalable, secure data pipelines and platforms to acquire, transform, and store large financial datasets. Enable AI/GenAI-ready data foundations for model training, inference, retrieval, and RAG workflows. Collaborate with cross-functional teams, ensure data quality, governance, observability, and compliance, and support production deployments and troubleshooting.
Top Skills:
AngularApache BeamApache FlinkApache KafkaSparkAWSAzureBitbucketCi/CdDatastageDocument ProcessingEmbeddingsETLGitJavaLlmLlmopsMlopsMongoDBPostgresPythonRagReactRedshiftScalaSemantic SearchSnowflakeSpring BootSQLTalendTypescriptVector Databases
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
