Specialist Data Engineer at Absa Group Limited (Absa)

Job Summary

• Apply critical thinking & problem solving skills to contribute to all phases of the development lifecycle & quickly produce well-organised, optimized, and documented source code to deliver high-performing, scalable, enterprise-grade applications.

Job Description

Role Overview:

• We are looking for a talented developer/Data Engineer with strong cloud knowledge to design, implement, and maintain robust data infrastructure in the cloud. In this role, you will work on a variety of data engineering tasks, including building ETL pipelines, integrating cloud data solutions, and ensuring data quality and availability for analytics. Your expertise in cloud technologies will be crucial in building scalable and reliable data architectures.

Key Responsibilities:

• Design, implement, and maintain scalable data pipelines in the cloud using modern technologies.
• Integrate, manage, and optimize cloud-based data solutions (AWS and Azure).
• Build and automate data workflows for data ingestion, processing, and transformation.
• Ensure data quality and consistency across different data sources.
• Collaborate with data scientists, analysts, and other stakeholders to provide reliable and accessible data for analytics and reporting.
• Monitor and optimize data infrastructure for performance and cost efficiency in the cloud.
• Manage data storage, including databases, data lakes, and other data repositories.
• Assist in the migration of on-premise data solutions to the cloud.
• Ensure data security and compliance with best practices and regulations.
• Troubleshoot data pipeline issues and implement solutions to improve system reliability.

Requirements:

• Proven experience as a Data Engineer (3+ years).
• Strong experience with cloud platforms such as AWS.
• Proficiency in data engineering tools and technologies (e.g., SQL, Python, ETL frameworks).
• Experience with cloud-native data services like AWS Redshift.
• Knowledge of data modeling, data warehousing, and cloud data storage solutions.
• Excellent problem-solving skills and the ability to work with large datasets.
• Knowledge of data security and governance practices.
• Familiarity with version control (e.g., Git) and CI/CD pipelines.

Nice-to-Have:

• Experience with containerization (Docker, Kubernetes).
• Familiarity with machine learning workflows and data science tools.
• Cloud certifications (e.g., AWS Certified Data Analytics, Data Engineer).
• Flexible working hours and remote work options.
• Professional development opportunities and career growth.
• A collaborative, inclusive, and innovative team culture.

Education

• Bachelor's Degree: Information Technology/Computer Science