Big Data Administrator at Sanlam Group

What will you do?
The successful incumbent will be responsible for the administration and operational and technical support of users of and applications running on Sanlam Big Data platforms. 
This includes both Big Data / Hadoop (Cloudera) and Fast Data (Kafka/Nifi) platforms currently deployed on-premise. 

The successful incumbent will also have experience with similar cloud-based platforms to help move relevant components of the architecture to the cloud. This includes supporting developers interacting with the platforms in troubleshooting, performance tuning and application design. The role requires a self-motivated and driven individual who have experience as a team leader or technical mentor and has a high level of ownership and accountability of the platforms being administered.

What will make you successful in this role?

• Day-to-day administration and operation of the supported platforms
• Operational monitoring of platform functioning and performance
• Health-checks, backup and recovery processes, disaster recovery tests
• User access management
• Capacity and performance monitoring (both platform and applications)
• Integration of 3rd party tools with the Big Data Platforms
• Support data engineers to implement technical solutions for data ingestion, transformation, and pipeline automation
• Support data stewards to implement technical solutions for data collection, quality improvements, integration, and processes

Qualification

• National Diploma in an Information Technology related discipline or Bachelor’s Degree in Computer Science, Informatics, Information Systems 

Experience

• 1-2 years' experience as a Data Engineer / Platform Administrator in a Big Data environment
• Experience in the following is require:
• Linux
• Hadoop / Cloudera platforms and services
• Hive/Impala/HBase/Phoenix/Atlas
• Experience of ETL toolsets (e.g. SAP Data Services, Microsoft SSIS, IBM DataStage) is preferred
• Strong Data Engineering background with a specific focus on staging high quality data
• A solid background in SQL, Information Architecture and ETL procedures is required
• Experience of Database technologies (e.g. SAP Hana, Teradata or similar) preferred and highly advantageous
• Experience with object-oriented/functional/scripting languages (e.g., Python, Unix Shell scripting, Java, Scala etc.) is preferred and highly advantageous.

Knowledge

• Knowledge of Streaming platforms and services is preferred
• Kafka/Nifi
• Knowledge of Identity management tools, principles and patterns is preferred
• LDAP/Kerberos/SAML/Ranger
• SQL skills and development using SQL is preferred
• Understanding of data warehousing principles (e.g. Kimball and Vault) is preferred but not essential
• Knowledge of Hardware configuration, Network configuration, distributed systems, virtualization and containerization and automation is preferred.

Knowledge and Skills

• Operating system software and hardware and utility software
• Software installations and upgrades
• Business requirements
• Security management and data recovery
• Change control

Closing Date:1st, April 2022