Lead ETL Hadoop Developer at Absa

About the job
Lead ETL Hadoop Developer
The main purpose of the job is to perform the role as Lead ETL Developer for Absa Corporate and Investment Bank (CIB). You will be responsible for participating and contributing to migrating an existing application to Hadoop and then enhancing this system as well as implementing new business requirements.
Responsibilities:

• Design, develop, automate and support complex applications to extract, transform and load data
• Develop solutions using Spark and Scala. (Possibly SSIS as well)
• Create and enhance data solutions enabling seamless delivery of data and is responsible for collecting, parsing, managing and analysing large sets of data
• Ensure data quality
• Clear, standardised documents that describe the ETL solution

Competencies:

• Ability to research and grasp new concepts at a fast pace.
• Excellent English and communication skills
• Planning and organizing
• Delivering results and meeting customer expectation

Knowledge and skills:

• Scala Development Language or C# or Java Development Language
• ETL Development skills e.g. SSIS
• Expert working knowledge of SQL
• Hadoop Architecture and Operating System (Cloudera)
• Hadoop SQL (Hive)
• Sound and diligent approach to BI/ETL development and testing

Experience Required:

• 8 + years’ experience
• Expert knowledge of SQL
• Development of ETL
• Working experience and knowledge of the Hadoop ecosystem (Hive, HDFS, Spark)
• Business knowledge in the Risk and Finance domain advantageous
• Proven technical skills
• University or post graduate degree in analytical subjects (mathematics, physics, engineering or IT), e.g. B.Sc Mathematics, Act. Sci, Statistics / FRM or PRMIA qualification

Preference given to the following additional skill-set

• Working understanding of Business Intelligence methodologies and BI software implementations e.g. Qlikview or Power BI
• Financial Services / Banking experience
• Ability to clearly demonstrate aptitude and attitude