Data Engineer - JHB at Expleo Group

Overview

The Data Engineer skill is required to enable the data lifecycle, namely the ability to integrate data between source system and the target database, hence provide good quality data by applying the necessary framework/s and governance to whomever may require it (BI and advanced analytics).

Works independently taking full responsibility for a certain area. Works on Development projects using available frameworks and tools and establishing plans for projects with on-time and on-budget project goals. Primary role in Development in the areas of building and working on enterprise grade software systems, in line with agreed plans and strategies.

Responsibilities

• Design, construct, install, test and maintain highly scalable data management systems
• Ensure systems meet business requirements and industry practices
• Build high performance prototypes and proof of concepts
• Research opportunities for data acquisition and new users for existing data
• Develop data set processes for data modelling, mining and production
• Integrate new data management technologies and software engineering tools into existing structures
• Create custom software components e.g.: specialised UDFs and analytics applications
• Employ a variety of languages and tools e.g.: scripting languages to marry systems together
• Install and update disaster recovery procedures
• Recommend ways to improve data reliablity, efficiency and quality
• Collaborate with data architects, modellers and IT Team members on project goals
• Determine in conjunction with data architect what data management systems are appropriate
• Obtain information from the Data Scientist to determine which data is needed for analysis to determine and provide data which is needed
• Support the achievement of the business strategy, objectives and values
• Stay abreast of developments in the field of expertise 
• Ensure personal growth and enable effectiveness in performance of roles and responsibilities

Qualifications

Essential –

Experience, Knowledge and Understanding of:

• Data warehousing concepts is advantageous.
• Ab Initio development experience (on-prem and cloud) is essential.
• Azure Cloud – Azure Data Factory is advantageous.
• Agile working approach essential 
•  Bachelor’s Degree in Computer Science, Information Systems,
• or other related field, or equivalent work experience
•  Certification in any one programming skill
•  An understanding of data warehousing concepts is advantageous.

Desirable

•  Additional course or certification in Development