Senior Data Engineer at Absa Group Limited (Absa)

Job Summary

• Designs, builds, manages, and monitors strategic data assets through the pipeline of data retrieval, storage, database design, and distribution of information assets throughout the organisation.

Job Description

• Design and assemble large, complex data sets to meet functional / non-functional requirements
• Source data from internal and external data sources, engaging with technical subject matter experts
• Design and build infrastructure required for optimal extraction, transformation and loading of data across a variety of data sources using various 'big data' technologies
• Help streamline a better supply chain for advanced analytics that goes from experimentation into production.  Identify, design and implement internal process improvements:  automating manual processes, optimising data delivery, re-designing models for greater scalability.
• Explore, analyse, and profile data from our various internal and external data sources, and help data scientist to prepare data for analytical purposes
• Resolve critical data modelling issues impacting the functionality of business intelligence products in production
• Engage with a wide range of technical stakeholders including data scientist, business analysis, other data engineers and solutions architects
• Work with data and analytics experts to strive for greater functionality in our data systems

Requirements

• More than 5 years of data engineering experience
• Bachelor`s degrees as a minimum qualification
• Proven experience with
• Scala or Python or Java development
• Spark and Hadoop data platforms
• Linux environments
• SQL scripting
• AWS
• Skilled in developing data pipelines
• Expertise in data analysis and exploration
• Strong problem solving abilities

Education

• Bachelor`s Degrees and Advanced Diplomas: Information Technology, Bachelor`s Degrees and Advanced Diplomas: Manufacturing, Engineering and Technology