Cloud Data Engineer at Vodacom

Role purpose:

• The G band Cloud Data Engineer is based within the Technology/Big Data and Analytics division.
• The Data Engineer delivers through self and others to:
• Load the data from local and group sources onto the shared platforms that are necessary for insight, analysis and for commercial actions. 
• Building applications that make use of large volumes of data and generate outputs that allow commercial actions that generate incremental value.
• Support local markets and group functions in obtaining business value from the data.

Your responsibilities will include:

• Design and develop highly performant, scalable, and stable Big Data cloud-native applications.
• Source data from a variety of different sources, in the correct format, meeting data quality standards and assuring timeous access to data and analytical insights.
• Build batch and real-time data pipelines, using automated testing and deployment.
• Build transformations to produce enriched data insights. 
• Integrate applications with business systems to enable value from analytic models and enable decision making.
• Define and implement best practices relating to cloud economics, software engineering, and data engineering to ensure a well-architected cloud framework with data management practices built into each design.
• Work with the architecture team to evolve the Big Data capabilities (reusable assets/patterns) and components to support the business requirements/objectives.
• Research, investigate and evaluate new technologies and methods to improve the delivery and sustainability of data applications and services.
• Make contributions to the process of defining best practices for the agile development of applications to run on the Big Data Platform.

The ideal candidate for this role have

• Matric/ Grade 12 is essential.
• 3 year IT or IS degree or diploma or related field is essential. 
• Relevant cloud certification at professional. 
• 8+ years of BI or related software development experience is essential
• Relevant practical working development experience with AWS (or GCP) big data analytics services. This includes AWS Glue, AWS Athena, and AWS Step Functions is essential.
• Agile exposure, Kanban, or Scrum.
• Experience with performance tuning for batch-based applications like Hadoop, including working knowledge using Nifi, Yarn, Hive, Airflow, and Spark.
• Experience with performance tuning streaming-based applications for real-time data processing using Kafka, Confluent Kafka, AWS Kinesis, GCP pub/sub, or similar.
• Experience working with serverless services such as AWS Lambda.

Closing Date: 16th, June 2022