Data Engineer at PayFast

The key focus of the role is to design, build, and integrate large amounts of data from multiple sources, providing the infrastructure for others (such as a BI Analyst) to pull it into various tools and analyse it. You will also be responsible for monitoring our production databases, making recommendations for optimization. You will work closely with Product, DevOps, our Architect and Technical Manager.

Core Competencies:  

•  Plan, build and maintain a Data Warehouse
• Combine raw information from different sources 
•  Design, develop, test, and maintain data architectures
• Design, develop, and test large stream data pipelines to ingest, aggregate, clean, and distribute data models ready for analysis
• Explore ways to enhance data integrity, quality, and reliability
•  Collaborate with other developers, architects, and tech leads to produce the most efficient and valuable solutions
• Implement features, technology, and processes that move us towards industry best practices, improving on scalability, efficiency, reliability, and security
• Own and operate systems in production, responding to incidents
• Monitor production databases, research and optimization

Requirements:

• Degree in Computer Science or Engineering or equivalent experience
• Previous experience as a data engineer, DBA, or similar role
• Significant technical experience and a proven track record of data modelling and schema design
• 4+ years’ experience with open source relational database systems (e.g. MySQL, MariaDB, PostgreSQL, etc.)
•  Experience working with large data sets and relational and non-relational databases
•  An understanding of database and data warehousing principles
•  Great numerical and analytical skills
• Strong problem solving skills: The ability to exercise judgment in solving technical, operational, and organizational challenges, to identify issues proactively, to present solutions and options leading to resolution
• Process oriented with great communication and documentation skills