Specialist Data Engineer at Absa Group Limited (Absa)

Job Summary

The Risk Services team within Group Shared Services is looking for a Specialist Data Engineer to work embedded as a member of squad OR; across multiple squads to produce, test, document and review algorithms & data specific source code that supports the deployment & optimisation of data retrieval, processing, storage and distribution for a business area.

Job Description

Education and experience required

• 5+ years of relevant experience
• Relevant B-Degree in Computer Science OR; equivalent level of industry certification in Technical field
• 3-5 years experience with designing and building, BI systems and complex data eco systems
• Preferable: 3 + years’ experience working in a Big data environment (advantageous for all, a must for high volume environments) – optimising and building big data pipelines, architectures and data sets with e.g. Java, Scala, Python, Hadoop, Apache Spark and Kafka
• Excellent communication, analytical skills and decision making ability in collaborative environments
• Advanced knowledge of SQL e.g. query authoring
• Knowledge of systems such as Windows, Linux etc
• Ability to create and maintain sophisticated CI / CD pipelines
• Excellent debugging and problem-solving skills

Competencies required

• Interpreting Information
• Developing Strategies
• Challenging Ideas
• Embracing Change
• Inviting Feedback
• Collaborative Team Work
• Producing Output
• Proactively Take Action

Accountability: Data Engineer

• Understand the technical landscape and bank wide architecture that is connected to or dependent on the business area supported in order to effectively design & deliver data solutions (architecture, pipeline etc.)
• Translate / interpret the data architecture direction and associated business requirements & leverage expertise in analytical & creative problem solving to synthesize data solution designs (build a solution from itscomponents) beyond the analysis of the problem
• Participate in design thinking processes to successfully deliver data solution blueprints
• Translate business questions to be solved into data requirements & define a data solutions to deliver against these requirements
• Create & Maintain Sophisticated CI / CD Pipelines (authoring & supporting CI/CD pipelines in Jenkins or similar tools and deploy to multi-site environments – supporting and managing your applications all the way to production)
• Contribute to the consolidation of data solutions into viable end products (in the language of business) that can be leveraged on an ongoing basis e.g. dashboards, reports etc.
• Facilitate peer reviews & feedback on data solutions
• Refine data analysis based on business & peer reviews
• Contribute to the assessments of the effectiveness and accuracy of new data sources & data gathering techniques
• Promote data literacy with your business stakeholders by sharing best practices and showing tangible
• business impact & recommendations as a direct result of the the data solutions provided
• Identify data risks and mitigate these (pre, during & post solution deployment / data delivery)
• Create business cases & solution specifications for various governance processes (if required)
• Apply data quality assurance frameworks and tools to guarantee data quality & data integrity (always) for specific data solutions
• Contribute to risk, governance, compliance & broader regulatory processes as a data expert (if &
• when required)
• Ensure designs & solutions support the technical organisation principles of self-service, repeatability, testability, scalability & resilience
• Apply general design patterns and paradigms to deliver technical solutions
• Inform & support the infrastructure build required for optimal extraction, transformation, and loading of data from a wide variety of data sources
• Support the continuous optimisation, improvement & automation of data processing, retrieval, storage & distribution processes
• Ensure the quality assurance and testing of all data solutions aligned to the QA Engineering & broader architectural guidelines and standards of the organisation
• Meaningfully contribute to & ensure solutions align to the design & direction of the Group Architecture & in particular data standards, principles, preferences & practices. Short term deployment must align to strategic long term delivery.
• Meaningfully contribute to & ensure solutions align to the design and direction of the Group Infrastructure standards and practices e.g. OLA’s, IAAS, PAAS, SAAS, Containerisation etc.
• Monitor the performance of data solutions designs & ensure ongoing optimization of data solutions
• Stay ahead of the curve on data processing, retrieval, storage & distribution technologies & processes (global best practices & trends) to ensure best practice

Education

• Bachelor's Degree: Information Technology

Closing Date: 25th, July 2022