Group Data Engineering Lead at AECI Limited

Job Description    

Purpose of the job

• The Group Lead Data Engineer is responsible for architecting, building, and maintaining scalable data pipelines, platforms, and infrastructure that support AECI's enterprise data and analytics strategy.
• This role ensures high-quality data ingestion, transformation, and delivery across various business domains while enforcing engineering best practices.
• The role is pivotal to the successful delivery of AI, analytics, and data democratization initiatives across global operations and requires close collaboration with data scientists, analysts, and technology teams.

Required outputs

• Design and implement robust and scalable data pipelines using Azure-native tools (ADF, Databricks, Synapse).
• Ensure automated and resilient workflows that process structured and unstructured data.
• Translate data needs into modern architectural blueprints.
• Enforce data modelling, engineering, and documentation standards.
• Contribute to AECI's enterprise data architecture in collaboration with enterprise architects.
• Integrate data from diverse sources (SAP, IoT, third-party APIs).
• Enable real-time and batch data streaming using Azure Event Hubs, Kafka, and Databricks.
• Implement CI/CD pipelines for data code. Use infrastructure-as-code for reproducible environments.
• Monitor pipeline health, data freshness, and failures.
• Enforce data security policies, access controls, encryption, and audit trails. Work with Data Governance teams to ensure adherence to policies and regulatory requirements.
• Lead the design and implementation of D&A portfolio frameworks and methodologies across local and global operations,
• Establish and enforce architecture standards, guidelines, and best practices across the development of enterprise D&A.
• Manage and track the number of architecture deviations identified in the D&A lifecycle and to identify and address any deviations, ensuring consistency and maintainability
• Measure the level of documentation completeness and comprehensiveness of the D&A portfolio documentation, ensuring that all stakeholders have access to the necessary information
• Lead the development and foster a culture of innovation and continuous improvement within the team.
• Promote a culture that supports high performance through performance management and employee engagement
• Mentoring, coaching and developing of the Data Engineering team
• Lead and develop the team, ensuring effective communication, training, and development opportunities
• Create a dynamic environment that promotes and rewards high performance

Qualifications & Experience    

• A bachelor's degree in a quantitative field like computer science, statistics, mathematics or actuarial science
• A Postgraduate qualification will be advantageous
• 5-8 years’ experience in IT with a minimum of 3 years in a Data Lead role.
• Experience working with various user applications (SAP ECC, Syspro, Success Factors etc.)
• 5+ years in data engineering or related field
• Strong experience with cloud platforms (preferably Microsoft Azure)
• Experience with tools like Spark, Databricks, Azure Synapse, Azure Data Factory, SQL, Python

Personal Attributes

• Attention to detail
• Time Management
• Presentation skills
• Analytical Skills
• Data modelling
• Metadata management
• Real-time data processing
• SAP BW, SAP BPC, SAC, Power BI
• Project Management
• Relating and Networking
• Delivering Results and Meeting Customer Expectations
• Applying Expertise & Technology
• Coping with Pressures and Setbacks

Closing Date    

• 2025/07/03