Specialist Data Engineer at Vodacom

 
The H Band Specialist: Data Engineer position is based within the Technology Business Unit.

The role of the Specialist: Data Engineer is to delivers through self and others to:

• Load the necessary data from local and group sources onto the shared platform that are necessary for analysis and for commercial actions;
• Building applications that make use of large volumes of data and generate outputs that allow commercial actions that generate incremental value
• Support local markets and group functions in obtaining benefiting business value from the operational data

Key accountabilities and decision ownership

• Designing and producing highly performing and stable applications to perform complex processing of massive volumes of data in a multi-tenancy Hadoop environment
• Building end-to-end applications that make use of large volumes of source data from the operational systems and output insights back to business systems
• Building real-time data processing applications which are integrated with business systems to enable value from analytic models to drive rapid decision making
• Working with the architecture team to contribute to evolving the Big Data capability
• Defining the technology components to be used on the Big Data Platform and investigating new technologies to identify where they can bring benefits
• Make contributions to the process of defining best practice for the agile development of applications to run on the Big Data Platform
   

Core Competencies, Knowledge And Experience

• Proven working experience in building and managing applications to process large amounts of data in a Hadoop ecosystem;
• Proven working experience with performance tuning applications on Hadoop and configuring Hadoop systems to maximise performance;
• Experience building systems to perform real-time data processing using Spark Streaming or Storm would be an advantage;
• Experience contributing to the development life-cycle for agile software

The ideal candidate for this role will have:
 

• Matric / Grade 12 essential
• 3-year Degree / diploma or Bachelor’s degree in Computer Science, Information
   

Systems, Or Other Related Field Essential

• 3+ years developer/ programming experience
• Working experience with using/programming python and/or Java, Spark, Hive, Kafka or
• simalar pub/sub technologies, noSQL databases like Cassandra, MongoDB and

ElasticSearch.

• DevOPS and test automation experience would be an advantages
• Some data science experience would be advantage (including working knowledge of
• H2O, Tensorflow, Spark ML, etc)