.png)
.png){kind=logo}
The Senior Data Engineer designs and maintains complex data systems. Responsibilities include implementing data quality solutions, collaborating with teams, and leading discussions on data quality standards.
Job Purpose and Impact
Key Accountabilities
Qualifications
- The Senior Professional, Data Engineering job designs, builds and maintains complex data systems that enable data analysis and reporting. With minimal supervision, this job ensures that large sets of data are efficiently processed and made accessible for decision making.
Key Accountabilities
- Accountable for Data Quality solution design, development, deploy using Informatica IMDC - Cloud Data Quality platform across Data Migration/ Conversion Projects and Steady State.
- Build DQ solution design or architecture, define best practice, develop re-usable & scalable DQ solution.
- Implement POC/ Pilot for DQ Solution using Informatica IDMC - Cloud Data Quality and Integration.
- Provide technical support and guidance to team on IDMC services - CDQ, CDI, CDP, CDGC, etc.
- Lead business and technical discussions, educate & drive adoption of the DQ Solution/ tools.
- Partner with Global & Enterprise data teams and consult on data quality capabilities to define, Implement and socialize data definitions, Standards/ Polices.
- Collaboration with business users & data quality trustee, Identify and Prioritize DQ issues & Remediation.
- Independently handle complex issues with minimal supervision, while escalating only the most complex issues to appropriate staff.
Qualifications
- 12+ years of experience in Informatica Data Quality Platform - IDMC Cloud DQ and IDQ.
- Proven experience in Informatica IDMC Cloud services - Cloud Data Quality (CDQ), Data Integration (CDI), Application Integration (CAI), Data Profiling, Address Doctor/AD6, Data Governance and Catalog (CDGC).
- Sound knowledge in Data Quality Solution design and Architecture using Informatica cloud Platform.
- Hands-on in IDMC - Cloud Data Profiling, DQ Rule creation and DQ Scorecard generation functionalities.
- Hands-on in IDMC - Match & Merge/ De-duplication process to identify Master & Subordinate records.
- Experienced in IDMC - Data Extraction, Data validation and Reports generation for batch & real-time.
- Hands-on in Informatica-Address Doctor/ AD6) - Address/ Location Cleansing, Standardizing and Validation
- Good knowledge in IDMC admin Tasks - Creation of Projects & connections, Schedules, etc.
- Good knowledge in other IDMC services - Administrator, Monitor, Operational Insights, CLAIR GPT, etc.
- Hands-on experience in Informatica Power Center, IDQ developer, IDQ Analyst, MDM, etc.
Top Skills
Address Doctor
Application Integration (Cai)
Clair Gpt
Cloud Data Quality
Cloud Data Quality (Cdq)
Data Governance
Data Integration (Cdi)
Data Profiling
Idq
Informatica Imdc
Power Center
Similar Jobs at Cargill
Food • Greentech • Logistics • Sharing Economy • Transportation • Agriculture • Industrial
The Senior Data Engineer designs and maintains data systems, ensuring efficient data processing, scalable solutions, and collaboration with teams for optimized data architecture.
Top Skills:
AirflowAWSAws GlueAzureDbtFlinkGCPIcebergJavaKafkaParquetPythonScalaSparkSQL
Food • Greentech • Logistics • Sharing Economy • Transportation • Agriculture • Industrial
Designs, builds, and maintains data systems that support analysis and reporting, developing data products and pipelines for decision making.
Top Skills:
Apache KafkaApache PulsarMs Power BiOraclePostgresPythonSnowflakeSQLSQL ServerTableau
Food • Greentech • Logistics • Sharing Economy • Transportation • Agriculture • Industrial
The Sr Data Engineer designs and maintains complex data systems for analysis and reporting, develops data solutions using cloud technologies, and optimizes data storage configurations.
Top Skills:
Cloud TechnologiesData EngineeringData LakeData ModelingData SystemsData Warehouse
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
