Snr Spec: IT Systems Developer (Data Engineer) at Liberty Group South Africa

Purpose
The purpose of this role is to run existing and develop new processes and objects using Microsoft SQL Server as the primary platform, in the development of web-based solutions. All interactions with the Microsoft SQL Server database are done via specific queries and procedures developed using this platform. The work also includes the assistance assist with the day-to-day support, maintenance and administration of existing MS SQL Server jobs related to the Salesforce Application. It also requires assistance to the various support teams in troubleshooting SQL object issues.

Key Responsibilities

• Relational data modelling in traditional relational database management systems. (Microsoft SQL Server, MySQL, PostgreSQL, AWS Athena, AWS Redshift)
• Data pipelining knowledge - data extraction and transformation. 
• Data transformation knowledge for reporting and analytics purposes. 
• AWS and Big Data technologies such as S3, Lambda, LakeFormation, Kafka, Redshift, RDS, Aurora, DynamoDB, ECS, Glue, SageMaker, EMR.
• Comfortable working with DevOps tools such as Git, Jenkins, CodeBuild, CodePipeline, CodeDeploy, GitLab pipelines.
• Work with stakeholders to define requirements and create data models.
• Monitor and evaluate data quality to ensure accuracy and completeness.
• Develop and maintain documentation for data processes and procedures.

Minimum Experience

• 3 – 6 years of experience in analyzing and using data to solve problems
• Ability to work in a team environment.
• Proficient in data analysis .
• A good understanding of the SDLC process, tools and techniques specifically as applied to software development methodology. Required to understand Agile methodology and ways of working.
• Experience working with security sensitive data (beneficial)
• Experience in the implementation of data visualization systems/technologies. 

Additional Minimum Experience

• Knowledge and experience on cloud services - AWS.
• Experience in MS SQL, PostgreSQL, MySQL, Python, R, Redshift and especially PySpark.
• Good understanding of data integrity and security best practices.
• Hands on experience in Exception Handling and Troubleshooting.
• Troubleshooting slow running queries, Profiling Performance Issues (Beneficial).

Minimum Qualifications

• Relevant tertiary qualification in Information Technology or Computer/Engineering/Mathematical Sciences and/ or at least 3-4 years relevant experience as a SQL developer as part of a team in a software development environment.