Senior Data Engineer (Western Cape) at Flash Group

Why this role matters

• As our Senior Data Engineer, you’ll be responsible for creating robust data pipelines from millions of transactions a day, integrating data from multiple sources, ensuring data quality and governance, and optimising data platforms for performance and scalability.
• This role plays a key part in enabling data-driven decisions by delivering trusted, accessible, and well-structured data to business stakeholders, analysts, and engineering teams

What you’ll own

• Own the migration of assigned workstreams from SQL Server to Microsoft Fabric, from assessment through cutover and decommissioning.
• Contribute to data architecture and platform design decisions for the target Fabric estate.
• Design, develop, and maintain scalable data pipelines.
• Develop and maintain data models for analytics and reporting.
• Ensure data quality, integrity, and reliability across platforms.
• Monitor and troubleshoot data platform performance issues.
• Implement data governance, security, and compliance standards.
• Assess and inventory the existing SQL Server estate — databases, SSIS packages, stored procedures, SQL Agent jobs, downstream report dependencies — and sequence the migration by risk and business value.
• Rebuild SSIS packages as Fabric-native pipelines, notebooks, or Dataflows Gen2.
• Assist in implementing Master Data Management across the estate.
• Refactor T-SQL and stored procedures for Fabric Warehouse compatibility, resolving unsupported constructs.
• Run parallel validation and reconciliation between legacy and Fabric outputs, and plan zero-downtime cutovers.
• Maintain and support the legacy SQL Server platform through the transition period, then decommission migrated components.
• Manage Fabric capacity consumption and platform cost.

Requirements

Experience we’re looking for

• Bachelor’s degree in computer science, Information Systems or Engineering.
• 5–8 years in data engineering, including hands-on SQL Server (T-SQL, SSIS, SQL Agent) in production.
• Demonstrable experience delivering a cloud data platform migration or greenfield Lakehouse/warehouse build.
• Microsoft fabric experience highly advantageous or directly transferable experience on Azure Synapse or Databricks.

Bonus points if you have…

• Preferred: DP-700 (Microsoft Fabric Data Engineer Associate)

You’ll thrive in the Herd if you have…

• Analytical Thinking: Systematically breaks down complex data and commercial structures to identify trends, risks, and opportunities that inform strategic decisions.
• Stakeholder Influence: Communicates financial insights clearly to non-finance stakeholders, including senior leadership and external partners, to drive alignment and action.
• Attention to Detail: Maintains accuracy and rigour across financial models, dashboards, and reporting, ensuring data integrity underpins all decision-making.
• Strategic Orientation: Connects day-to-day financial analysis to broader divisional and company strategy, proactively identifying growth levers and efficiency gains.
• Adaptability: Thrives in a fast-paced, evolving environment where product portfolios, partner relationships, and commercial structures change frequently.
• Problem Solving: Approaches challenges with a solutions-oriented mindset, balancing speed and thoroughness to deliver actionable outcomes under pressure.

Perks that make your life easier

• Catered lunch four days a week for office-based team members.
• An open coffee bar and snacks.
• Employee Assistance Programme.
• Corporate Social Investment events and opportunities to give back.
• Free on-site parking.
• Access to LinkedIn Learning.
• Social events throughout the year.
• Group risk benefits.
• Flash Club, our employee engagement programme where you can earn up to five additional leave days by completing all categories within a cycle.