Senior Specialist: Cloud Data Engineer at Vodacom

Role Purpose

The Senior Specialist: Cloud Data Engineer delivers through self and others to:

Load the data from local and group sources onto the shared platforms that are necessary for insight, analysis and for commercial actions.Building applications that make use of large volumes of data and generate outputs that allow commercial actions that generate incremental value.Support local markets and group functions in obtaining business value from the data

Your Responsibilities Will Include

• Design and develop highly performant, scalable and stable Big Data cloud native applications
• Source data from a variety of different sources, in the correct format, meeting data quality standards and assuring timeous access to data and analytical insights
• Build batch and real-time data pipelines, using automated testing and deployment
• Build transformations to produced enriched data insights
• Integrate applications with business systems to enable value from analytic models and enable decision making
• Define and implement best practices relating to cloud economics, software engineering and data engineering to ensure a well-architected cloud framework with data management practices built in to each design.
• Work with the architecture team to evolve the Big Data capabilities (reusable assets/patterns) and components to support the business requirements/objectives
• Research, investigate and evaluate new technologies and methods to improve delivery and sustainability of data applications and services
• Make contributions to the process of defining best practice for the agile development of applications to run on the Big Data Platform

The Ideal Candidate For This Role Will Have

• 3 year IT or IS degree or diploma or related field is essential
• Relevant cloud certification at professional or associate level
• 5+ years BI or related software development experience
• Agile exposure, Kanban or Scrum
• Experience managing the development life-cycle for agile software development projects
• Expert level experience in designing, building and managing data pipelines for batch and streaming applications
• Experience with performance tuning for batch based applications like Hadoop, including working knowledge using Nifi, Yarn, Hive, Airflow and Spark
• Experience with performance tuning streaming based applications for real-time data processing using Kafka, Confluent Kafka, AWS Kenesis, GCP pub/sub or similar
• Experience working with serverless services such as AWS Lambda
• Relevant practical working development experience with AWS (or GCP) big data analytics services. This includes AWS Glue, AWS Athena, and AWS Step Functions
• Working experience with other distributed technologies such as CassandraDB, MongoDB, Elastic Search
• Java and Python programming ability would be an advantage
• The base location for this role is, Midrand, Vodacom Campus
• The Company’s approved Employment Equity Plan and Targets will be considered as part of the recruitment process. As an Equal Opportunities employer, we actively encourage and welcome people with various disabilities to apply
• Vodacom is committed to an organisational culture that recognises, appreciates and values diversity & inclusion.