Data Engineer – Microsoft Fabric (iOCO0115) at iOCO

Job Description

• We are looking for an experienced Data Engineer with strong Microsoft Fabric experience to join our Data & Analytics team. The successful candidate will be responsible for designing, developing, and maintaining scalable data solutions that enable reliable data integration, transformation, storage, and analytics across the organisation. You will work closely with Data Analysts, Data Scientists, BI Developers, Architects, and business stakeholders to ensure data is accessible, trusted, well-structured, and ready for reporting and advanced analytics.

What you'll do:

• Design, build, and maintain scalable data pipelines and data integration solutions.
• Develop data solutions using Microsoft Fabric, including components such as:
• Fabric Data Factory
• OneLake
• Lakehouse
• Data Warehouse
• Dataflows Gen2
• Fabric Notebooks
• Build and optimise ETL/ELT processes across multiple structured and unstructured data sources.
• Develop and maintain Lakehouse and Data Warehouse architectures.
• Ingest data from APIs, databases, cloud platforms, files, and other enterprise systems.
• Transform, cleanse, validate, and prepare data for reporting, analytics, and data science use cases.
• Develop solutions using SQL, Python and/or PySpark.
• Implement data quality, governance, monitoring, and validation processes.
• Optimise data pipelines and queries for performance, scalability, and cost efficiency.
• Support the development of semantic models and downstream Power BI reporting solutions.
• Work with stakeholders to understand data requirements and translate these into technical solutions.
• Troubleshoot data pipeline failures, integration issues, and data quality problems.
• Maintain appropriate technical documentation, data mappings, and solution designs.
• Follow data security, governance, privacy, and access-control standards.
• Support CI/CD and deployment processes across development, test, and production environments.
• Contribute to the continuous improvement of the organisation's modern data platform and engineering practices.

Your Expertise:

• Relevant qualification in Computer Science, Information Technology, Data Engineering, or a related field.
• Proven experience working as a Data Engineer or in a similar data-focused role.
• Hands-on experience with Microsoft Fabric.
• Strong experience with data integration and ETL/ELT development.
• Strong SQL skills.
• Experience with Python and/or PySpark.
• Experience working with Data Lakes, Lakehouses, and/or Data Warehouses.
• Experience building and managing data pipelines.
• Good understanding of dimensional modelling and data modelling principles.
• Experience working with relational and non-relational data sources.
• Understanding of data quality, governance, security, and access management.
• Strong troubleshooting and problem-solving skills.
• Ability to work across technical and business teams.

Advantageous Skills:

• Experience in any of the following would be beneficial:
• Microsoft Azure
• Azure Data Factory
• Azure Data Lake Storage
• Azure Synapse Analytics
• Databricks
• Power BI
• Delta Lake / Delta tables
• Spark
• Azure DevOps
• Git and CI/CD
• APIs and real-time or streaming data integration
• Microsoft Purview
• Medallion architecture
• Data governance and metadata management

Key Competencies:

• Strong analytical and problem-solving ability
• Attention to detail and commitment to data quality
• Ability to work independently and within a collaborative team
• Strong communication skills
• Ability to translate business requirements into practical data solutions
• Comfortable working in a fast-paced and evolving data environment
• Passion for modern data technologies and continuous learning

Ideal Candidate:

• The ideal candidate is a hands-on Data Engineer who understands the broader Microsoft data ecosystem and has practical experience using Microsoft Fabric to build modern, scalable data platforms.
• You should be comfortable working across ingestion, transformation, storage, modelling, and delivery of data, while collaborating with both technical teams and business stakeholders.

 Other information applicable to the opportunity: 

• Contract position
• Location: Johannesburg