Data Engineer at Datacentrix

About the job

Our client is currently in the process of recruiting 4X DataEngineer's (Junior, Intermediate, and Senior) for a 4 Month's project to deliver business processes, communication, collaboration, and knowledge management through the deployment, support, and maintenance of enterprise IT/OT technology, infrastructure, applications, and Mine Technical systems.

Responsibilities:

• Develop ETL pipelines. The data transformations will be developed in Azure Databricks using Python and on Azure SQL using T-SQL and deployed using ARM templates

• Combine and curate data in a central data lake

• Serve data for application and analytics through a variety of technologies such as SQL, Server Synapse, CosmosDB and TSI

• Build transformation pipelines into dimensions and facts and therefore a strong knowledge of standard BI concepts is mandatory

• Build stream pipelines leverage IoT Hub, Event Hub, Databricks streaming, and other Azure stream technologies.

• Work in a fluid environment with changing requirements whilst maintaining absolute attention to detail.

Qualifications

• Matric - Grade 12

• An undergraduate qualification (Bachelor's degree or equivalent) in the relevant IM discipline and/or Technical competencies and certification with relevant years of experience in a similar role.

Role-specific knowledge: 

• Data Lake 

• Data Modeling

• Data Architecture

• Azure Data Environment