Senior Data Engineer at IndSAfri

About the job

• We are looking for an experienced Senior Data Engineer to join a leading organization and play a key role in designing, building and supporting scalable data engineering solutions.
• This is a hands-on senior role where Python, SQL and AWS are critical, with responsibility for production-ready data pipelines, cloud data platforms, engineering standards and technical guidance.

CORE TECHNICAL REQUIREMENTS

• Strong hands-on Python experience – essential
• Advanced SQL experience – essential
• Strong hands-on AWS experience – essential
• Proven experience delivering production-ready data pipelines and data platforms
• Strong understanding of data modelling, data warehousing and analytics-oriented schemas
• Experience with batch and incremental data processing
• Experience ingesting data from relational databases, cloud storage, APIs and file-based sources
• Experience with Git, CI/CD and automation
• Experience working within Agile or SAFe environments

KEY RESPONSIBILITIES

• Design and implement scalable data ingestion and transformation pipelines across multiple systems and data domains.
• Build robust batch and incremental processing solutions.
• Implement appropriate error handling, monitoring, alerting, validation and reconciliation.
• Design data solutions aligned to data platform strategy and target architecture.
• Contribute to the evolution of a cloud-based, AWS-aligned data environment.
• Assess solutions for security, performance, cost and supportability.
• Review data engineering code and configurations and contribute to engineering standards and best practices.
• Optimise existing pipelines and data models to improve performance, reliability and maintainability.
• Apply version control, automated testing, CI/CD and structured release practices.
• Provide technical guidance and coaching to less experienced Data Engineers.
• Collaborate with Analytics, BI, Data Science, Product and business stakeholders.
• Support operational readiness, monitoring, incident resolution and root cause analysis.
• Build solutions with appropriate data security, privacy, access control and governance considerations.
• Maintain technical documentation covering pipelines, data models and operational requirements.
• Contribute to Agile ceremonies, sprint planning, estimation, prioritisation and continuous improvement.
• Identify practical opportunities to use approved AI tooling across data engineering, including pipeline analysis, optimisation, testing, documentation and data exploration.
• Validate AI-assisted outputs and ensure their use remains aligned with security and governance requirements.

REQUIREMENTS

• Bachelor’s degree in computer science, Information Systems, Engineering or a related discipline.
• 4–7+ years of professional experience in Data Engineering or related roles.
• Strong Python, SQL and AWS experience.
• Demonstrated experience delivering production-ready data pipelines and platforms.
• Strong foundation in data modelling and data warehousing principles.
• Experience working within Agile or SAFe delivery environments.
• Experience using AI tooling within engineering workflows.
• Practical experience applying AI to support data pipeline understanding, optimisation, testing or documentation.
• Understanding of responsible AI use and validation of AI-assisted outputs.
• Familiarity with analytics and BI tools such as Power BI.
• Experience coaching or guiding other engineers.
• Strong analytical, problem-solving and communication skills.
• Understanding of data security, privacy, governance and engineering risk.

If you are a Senior Data Engineer with strong hands-on experience in Python, SQL and AWS and are looking for a permanent opportunity in Centurion, we would like to hear from you. Apply with your updated CV