The Data Engineer will analyze data requirements, design data models, manipulate data for application use, ensure data quality, and mentor developers. Requires strong SQL and data architecture expertise.
Position exists for a Data Engineer. This requires an analytical, accountable and multi-talented individual who has a proven development background, good communication skills (written and spoken) and good understanding and experience of data architectures, modelling and design.
This person will work with Business Analysts, Application Developers and BI Analyst Developers with the aim of understanding data requirements, designing and implementing new/enhanced data models to support and enable application development and information retrieval, preparation and presentation.
Responsiblities
- Analyse data requirements and design conceptual, logical and physical models to facilitate the creation and management of data assets.
- Manipulate and transform data to facilitate efficient processing and consumption by applications and information presentation tools.
- Contribute to development efforts, including utilising your development background and knowledge to deliver requisite outcomes, including coding.
- Provide quality assurance and checking of data.
- Providing input into governance policies and control of data in context of various frameworks/regulations, e.g. POPIA and company requirements.
- Contribute to data architecture thinking and design.
- Assist with performance tuning and assistance where needed.
- Provide technical expertise in data storage structures, data cleansing, data mining.
- Support initiatives for data integrity, normalisation, quality control
- Work with other Architects to ensure adherence to principles and standards and give effect to Architecture Designs.
- Mentor and support other developers with your experience and knowledge of SQL and appropriate data manipulation and extraction techniques.
Skills and Qualifications
- Bachelors or comparable qualification in computer science, information systems.
- 5+ years’ experience in data analysis, design, modelling and development in an enterprise environment developing relational databases.
- Proficiency in industry standard techniques for data modelling.
- Strong problem solving skills.
- Strong verbal and written communication skills in English.
- Advanced SQL skills for data manipulation, retrieval and transformation.
- Strong consultative, facilitation and consensus building skills.
- Experience with Business Intelligence products.
Qualities and Competencies:
- Accuracy
- Analysing and forming opinions
- Cooperation
- Devotion to quality
- Innovating
- Performing under pressure
- Result orientated
Similar Jobs
Automotive • eCommerce • Fintech • Transportation
The Data Engineer will develop and maintain data pipelines, perform data extraction and transformation, and support data analytics across the enterprise.
Top Skills:
AirbyteApache AirflowGoogle BigqueryKubernetesPandasPysparkPythonSQL
Artificial Intelligence • HR Tech • Information Technology • Social Impact
The Data Engineer will analyze and interpret data, design scalable databases, optimize data operations, and develop LookML models while collaborating with various teams.
Top Skills:
BigQueryDbtFivetranGitLookerLookmlPythonSQL
Fintech • Payments • Financial Services
As a Junior Data Engineer, you will design and maintain data architectures, process large data sets, and work with tools like Spark and AWS.
Top Skills:
AirflowAWSDockerDynamoDBFlinkHadoopKafkaKinesisKubernetesLookerMySQLPostgresPythonRabbitMQRedisRedshiftSnsSparkSQLSQL ServerSupersetTableau
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
