Senior Data Engineer and Technical Lead at Sanlam Group

• Design, document and communicate technical solutions that deliver on business requirements.
• Fulfil the role of subject matter expert on all technical aspects of BI Solution Development.
• Ensure and validate Quality of all BI development / modelling activity incl. code reviews, issue resolution and general support.
• Assemble large, complex data sets to meet functional / non-functional business requirements.
• Build the infrastructure required for optimal Extraction, Transformation, and Loading (ETL) of data from a wide variety of data sources using various ‘big data’ technologies.
• Resolve critical data modelling issues impacting the functionality of BI products in production.
• Help streamline a better data supply chain for advanced analytics that goes from experimentation into production.
• Identify, design, and implement internal process improvements: automating manual processes, optimising data delivery, re-designing models for greater scalability.
• Develop technical standards and best practices.
• Identify opportunities to enhance and automate technical processes and solutions across BI projects and support operations.
• Engage with a wide range of technical stakeholders including data scientists, business analysts, other data engineers and solutions architects.
• Work with data and analytics experts to strive for greater functionality in our data systems.
• Support data stewards to establish and enforce guidelines for data collection, quality improvements, integration and processes.

The complexity and variety of the most common challenges and problems.

• Delivering in a complex analytic environment
• Working with a high need for information security
• Diligence required when resolving data and technical issues and interacting with other support teams.
• Demanding business community

How the job will typically impact the business and where the impact will be felt.

• Information is an asset and it can be used strategically to gain a competitive edge in the market, hence
• Timely delivery required - information is key to business decisions
• Accurate delivery required - information is key to business decisions
• Access to information - information is key to business decisions

Additional Requirements

• 4+ years' experience as a data engineer / modeller experience in a BI environment.
• 2+ years' experience as an Architect in a BI environment.
• Ability to comply to and manage reusable assets under the governance framework of the DSUA and MOU
• Excellent SQL skills
• Ability to code in Java, Python, R plus other languages - advances, including understanding of SDLC, GIT, Code management / standards / re use and API integration (Expert)
• Ability to do cost estimations for new workloads
• You have a strong data modelling / engineering background with the ability to interpret business requirements and technical solutions to develop components of or complete data models.
• A solid background in SQL, application and information architecture and ETL procedures is required.
• Experience working on SAP Hana & Cloudera is preferred and highly advantageous.
• Experience with object-oriented/object functional scripting languages: Python, Java, C++, Scala or related is preferred but not essential.
• Data warehousing principles based on Kimball and Data Vault patterns
• Development experience in BI
• Agile Development
• Development using Java, SQL, etc