Data Engineer - Manager at PwC South Africa

Key Responsibilities:

• Lead the design, development, and maintenance of data pipelines to support seamless data flow within the organisation.
• Implement and manage testing and deployment processes to ensure data reliability and integrity.
• Oversee DevOps practices, including continuous integration/continuous deployment (CI/CD) pipelines, version control, and automated testing.
• Supervise the quality assurance of code and data processes, ensuring alignment with industry best practices.
• Mentor and guide team members on data engineering techniques and DevOps practices.
• Collaborate with stakeholders to gather requirements and ensure alignment on project objectives.
• Manage Agile project delivery, including sprint planning, backlog management, and project updates.
• Monitor and optimise data pipelines for performance and scalability.
• Stay informed of emerging technologies and best practices in data engineering and DevOps.

Qualifications:

• Bachelor's degree in Computer Science, Information Systems, or a related field.
• Strong experience in data pipeline development and DevOps, particularly within AWS and Microsoft platforms.
• Proficiency in SQL, ETL processes, and data warehousing.
• Python advantageous.
• Knowledge of CI/CD pipelines, infrastructure as code (IaC), and version control systems.
• Proven experience in leading data engineering projects and managing a team.
• Experience with Agile project delivery methodologies.
• Excellent communication, teamwork, and leadership skills.
• Ability to manage multiple tasks and projects concurrently.
• Familiarity with data governance and data security best practices