Big Data Engineer - Sandton at Absa Group Limited (Absa)

Job Summary

• Support high-performing, scalable, enterprise-grade application design & development in agile teams by producing, testing, documenting & reviewing source code.

Job Description

• Do you love or enjoy working with data integration on Hadoop data lake? Are you an innovative, responsible, fast learning and goal-oriented Data Engineer that is not afraid to go the extra mile to ensure successful team project delivery? Do you see project roadblocks as challenges that motivate you to be better at what you do? Is your desire to automate repetitive tasks? Do you want to treat data as an asset?
• If you answered yes to all of the above questions, the Data Rails team within CIB Transactional Banking Tech has the perfect opportunity for you. Be part of the young, energetic team that provides a one-stop data lake service to our customers. As a Data Engineer, you will onboard new data assets to a data lake, as well as optimize existing data pipelines to the latest data integration standards using mostly SPARK, SCALA and JAVA on Hadoop ecosystem. You will also be part of the exciting migration journey to Cloud (AWS) that the team will embark on in the near future.

Key Accountabilities: 

Development and program support

• Development of data integration and analysis solutions using various big data technologies with focus mainly on Spark/Scala and Java development.
• Attend all scoping and planning workshops for BAU and project initiatives and provide input into the design process to ensure that solution meets the business requirements.
• Accurately estimate project activities and communicate deviations promptly to the lead or project manager for appropriate action by participating in development planning and progress review sessions.
• Testing and peer code review.

Stakeholder and Management Reporting

• Attend relevant project progress review sessions and provide feedback when required.

Key critical skills and experience required:

• 2+ years of Big Data development experience using Spark, Scala, Java
• Strong understanding of batch processing and scripting
• Hadoop architecture knowledge with the ability to troubleshoot and optimize poorly performing tasks
• Good understanding of Java programming
• Good understanding of metadata driven architecture
• Understanding the end to end solutions delivery lifecycle

Key competencies required:  

• Team player
• Positive mindset and approach
• Ability to effectively multi-task
• Ability to cope with pressure and setbacks while still meeting the deadlines
• Planning, organizing and documentation
• Delivering results and meeting customer expectations
• Excellent English and communication skills
• Application development and support
• Participate in future Architecture build

Education

• Bachelor's Degree: Information Technology