Data Engineer - ICT Data And Analytics Services Department - Pretoria at FSCA South Africa

Key Performance Area:

• Develop, innovate and maintain the data architecture that will drive various initiatives/projects across the organisation
• Collaborate with teams to build strategic data models that will help enable the achievement of business outcomes
• Create robust and automated pipelines to ingest and process structured and unstructured data from source systems into analytical platforms
• Conduct complex data analysis and report on results
• Build and optimise ‘big data’ data pipelines, architectures and datasets
• Build processes supporting data transformation, data structures, metadata, dependency and workload management
• Develop and maintain datasets
• Analyse raw data and Interpret trends and patterns
• Prepare data for prescriptive and predictive modelling
• Reformulate existing frameworks to optimize functionality.
• Deploy and schedule ETL jobs (Batch/Micro batch processing)
• Partner with various stakeholders within the organisation to drive the improvement in the way that data is stored and consumed.
• Support application team development by writing stored procedures, functions etc. 
• Develop and maintain data security and permissions, including data encryption and database user access controls and logging.
• Build algorithms and prototypes.
• Lead business stakeholder’s engagement on Data Engineer standards and reporting requirements in order to derive the data driven strategy of the FSCA.

Requirements

• A degree in computer science, IT, or related field. Data engineering certification is a plus, with more than 5 experience as a data engineer/ETL Developer.