Senior Data Engineer

Senior Data Engineer 

Location: [Location(s) / Remote] – Hybrid – Manhattan, NYC

Employment Type: Contract

Company Overview  

Trianz is an applied AI solutions company that accelerates customer business transformation through AI powered "Transformation Services as a Software Model". With 25+ years of transforming enterprises, we've evolved to a product-led, platform-driven organization serving global enterprises across Financial Services, Insurance, Healthcare, Hi-Tech, Manufacturing, and other industries.  

With global presence across 4 continents, our platform portfolio under the unified Concierto brand delivers end-to-end transformations including solutions for Migrate, Manage, Maximize, Modernize, Insights & Agentic AI, and SecOps - delivered through strategic partnerships with leading hyperscalers.  

We're building the premier innovation-led organization in the digital transformation space through AI-first methodologies and data-driven excellence - RevolutionAIzing Transformations.

Role Overview

We are seeking  a Senior Data Engineer will design, build, and support data pipelines and analytics datasets that power enterprise reporting across Finance, Technology, and Operations. This role focuses on ingesting data from corporate systems, organizing it in a cloud-based data lake, and enabling reliable reporting using Amazon QuickSight.

The ideal candidate is a hands-on data engineer who is comfortable working with modern AWS data services, partnering with business stakeholders, and supporting production reporting workloads. This role operates in a growing analytics environment and will help establish practical standards for data ingestion, modeling, and reporting.

Context : This engineer will build and maintain Python-based ETL pipelines within AWS Glue. They will own transformation logic, manage orchestration and metadata cataloging, and ensure data is securely processed and accessible for downstream analytics and AI tools.

The role requires strong ownership of pipeline reliability, data quality, and performance tuning.

Experience with dbt and Snowflake will become increasingly important as the platform evolves.

Key Responsibilities 

• Design, build, and maintain scalable data ingestion frameworks using AWS native services (e.g., Glue, Lambda, S3, Step Functions) and SnapLogic to data into the data lake.
• Architect and manage the enterprise data lake on Amazon S3 using Apache Iceberg, including partitioning strategies, schema evolution, metadata optimization, and lifecycle management.
• Develop robust data transformation pipelines (ELT/ETL) to standardize, cleanse, and enrich source system data for downstream analytics and operational use cases.
• Develop and maintain reporting-ready views and queries using Amazon Athena and AWS Glue metadata.
• Implement and monitor data quality frameworks, including validation rules, reconciliation checks, and anomaly detection to ensure integrity and reliability of enterprise data asset
• Collaborate with Finance, Technology, and Operations stakeholders to translate business requirements into scalable data architecture and transformation logic.
• Establish data governance best practices, including documentation, lineage racking, access controls, and change management processes.
• Monitor pipeline health and data quality, investigate data issues, and support recurring reporting cycles

Essential functions and responsibilities: 

• Work with Architects, Development teams, Information Security, Infrastructure and Operations to develop requirements for common services and work with the team to create and maintain detailed functional and technical specifications and user guides.
• Ensure Common Services acts like a product with regular updates and a focus on the customer.
• Support the operation of the common components and services that the team is responsible for.
• Ensure adherence to change management and risk policies.
• Continue to drive modern enterprise application development with a focus on the cloud.

Success factors/job competencies:

The candidate must be detail-oriented while also understanding the broader enterprise environment and how data supports business decision-making.

This role requires a strong team player who can work effectively across organizations and communicate clearly with technical teams, business partners, and leadership. The ability to balance hands-on execution with collaboration and operational responsibility is critical to success.

Performance standards:

• Deliver tasks and projects accurately and on schedule.
• Maintain high standards of professionalism and accountability.
• Demonstrate effective teamwork and cross-functional collaboration.
• Adhere to and support Technology & Operations and TCH strategic goals.
• Communicate clearly and effectively with internal stakeholders and external partners as needed.

Ideal Candidate Profile 

• 14+ years of overall software development experience, with significant exposure to data-centric systems.
• 7+ years of hands-on experience in data engineering, analytics engineering, or related data platform roles.
• Strong expertise in SQL, with proven experience designing and building high-quality analytical datasets to support reporting and business intelligence.
• Extensive experience working with AWS data platforms, including Amazon S3, Amazon Athena, AWS Glue, and AWS Unified Data Catalog.
• Hands-on experience integrating data from SaaS and enterprise systems using ETL/ELT tools such as SnapLogic.
• Experience supporting and optimizing data models for BI tools such as Amazon QuickSight, Tableau, or Microsoft Power BI.
• Ability to work independently, manage priorities effectively, and collaborate with both technical teams and non-technical stakeholders.

Education:

• Bachelor’s degree in Computer Science, Engineering, Information Systems, or equivalent experience.

Qualifications desired:

• Experience working with payment systems, financial networks, and messaging protocols such as ISO 20022, SWIFT, and NACHA.
• Familiarity with financial data standards, transaction processing workflows, and reconciliation processes.
• Experience operating within highly regulated environments (e.g., banking, fintech, healthcare), with a strong understanding of compliance requirements.
• Solid knowledge of advanced data security principles, including encryption (in transit and at rest), tokenization, data masking, role-based access control (RBAC), and secure data governance practices.

Why choose Trianz?

• Personal Growth: Startup agility with enterprise impact. Experience rapid innovation cycles while working on Fortune 500 transformations.
• AI-First Future: Where humans and AI revolutionize business. Lead the charge in implementing AI-driven transformation at scale.
• Global Impact: Shape transformation across continents. Work with diverse teams and clients spanning Americas, Europe, Asia, and beyond.
• Executive Access: Direct impact on Fortune 500 strategies. Work alongside C-suite leaders and influence major business decisions.
• Ownership & Entrepreneurial Spirit: Your ideas, our platform, global impact. Zero bureaucracy culture with decision-making autonomy and rapid execution.

 Equal Employment Opportunity

Trianz is an Equal Opportunity Employer and does not discriminate based on race, color, creed, national or ethnic origin, gender, religion, disability, age, political affiliation or belief, special needs veteran, veteran of the Vietnam Era, or citizenship status (except in those special circumstances permitted or mandated by law). We comply with all state and federal laws and regulations protecting employees and applicants against illegal discrimination, retaliation, and harassment. Our policy is available upon request. We consider qualified applicants with criminal histories, consistent with applicable federal, state, and local law. Trianz participates in the E-Verify program in certain locations, as required by law. We are committed to providing reasonable accommodation for all qualified individuals with a disability or other reasons protected by applicable laws. If you require assistance or accommodation due to a disability or special needs to search for a job opening or apply, please email [email protected] with your request and contact information.

Trianz Privacy Notice

Trianz respects your privacy and wants to ensure we comply with applicable Data Privacy Regulations as per local regulator laws. Please review our privacy policy at https://www.trianz.com/privacy-policy for more..