IT Data Engineer X3 Global Grade 11 at Barloworld Equipment

Core purpose of the role

• Data Engineers are responsible for designing, maintaining, and optimizing data infrastructure for data collection, management, transformation, and access. They are responsible for creating data pipelines that convert raw data into usable formats for data consumers to utilize. The role will involve collaborating with Business and IT stakeholders at all levels to ensure that our data management initiatives add value to the business.

Key deliverables and outputs

• Develops and maintains scalable data pipelines and builds out new integrations to support continuing increases in data volume and complexity.
• Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility, and fostering data-driven decision making across the organization.
• Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
• Writes unit/integration tests, contributes to data engineering wiki, and documents work.
• Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
• Works closely with a team of frontend and backend engineers, product managers, and analysts.
• Defines company data assets (data models), data pipelines to populate data models.
• Design data integration solutions and data quality approaches for solutions.
• Designs and evaluates open source and vendor tools for data lineage.
• Works closely with all business units and engineering teams to develop strategy for long term data platform architecture.
• Maintains technical and operational metadata during data solution development.
• Has experience in advanced query performance and query optimisation.
• Can develop complex SQL to implement complex business logic.
• Translate the functional requirements to high level design and build technical specifications document
• Work with internal and external stakeholders to assist with data-related technical issues and support data infrastructure needs.

Internal customers

• Business functional teams
• IT and digital leadership teams

External stakeholders

• External customers
• IT Service providers
• Qualification, Experience and Competencies

CANDIDATE REQUIREMENTS

Academic qualifications

Essential:

• Diploma in IT related field or equivalent qualification; or
• BTech in IT related field or equivalent qualification

Advantageous:

• Certification in Data Integration technologies
• CDMP
• Postgraduate degree in IT or related field

Work experience

Essential:

• 4 – 10 years practical experience as a Data Engineer/ ETL Developer
• Experience in the following technologies –
• 3 years’ experience in Data Factory
• 2 years’ experience in Azure Synapse
• 3 years’ experience in Azure SQL
• 2 years’ experience in PowerBI
• 1 years’ experience in Databricks
• 5 years’ experience in SQL
• Experience in developing and building data pipelines
• Experience in troubleshooting and debugging of data pipelines

Advantageous:

• Experience in Agile and DevOps squads
• Experience in Informatica
• Experience in Teradata
• Experience in SAP Data Services
• Knowledge

Skills

Essential:

• Knowledge of Data Warehousing principles
• Working knowledge of Data Integration technologies
• Knowledge of scripting languages
• Working knowledge of data visualisation libraries
• Solid understanding of all the underlying infrastructure, including data integration tools, ETL/ELT processes, data formatting and warehouse architecture
• Good knowledge of databases

Advantageous:

• Understanding of ITIL
• Exposure to Agile practices
• Strong communication skills
• Well-developed interpersonal skills to build relationships.
• Well-developed critical, conceptual, and creative thinking and problem-solving skills to perform in-depth analysis of data and design new Business Intelligence solutions
• Excellent mathematical reasoning, analytical and solutioning skills
• Strong computer, technology, and systems skills
• Ability to work cooperatively with other teams

Personal Attributes
Essential:

• Strong attention to detail
• Passion for optimising business performance
• Orientation to growing and nurturing relationships
• Strong customer centricity
• Problem solver
• Remaining resilient under stress and pressure
• Focus on analysing and solving problems
• Preference for thinking practically and laterally

Advantageous:

• Preference for thinking practically and laterally
• Strong inclination for change agility
• Preference for team working
• Commitment to behaving ethically and correctly
• Concern for working within parameters
• Concern for communicating clearly
• Commitment to maintaining business awareness