Data Engineer - Johannesburg at NTT Ltd.

Key roles and responsibilities:

• Provide detailed advice regarding data applications and executing specialised tasks
• Create databases optimised for performance and to structure data to enable analysis thereof
• Provide support and assistance on data initiatives and ensure optimal data delivery architecture in support of client project
• Build the infrastructure for optimal extraction and transformation of data from a wide variety of data sources
• Design and develop scalable ETL packages from the business source systems
• Develop the ETL routines in order to populate data from sources
• Build test scenarios to enable testing and validation to support accuracy of data transformation
• Enable and run data migrations across different databases and different servers
• Define and implement data stores based on system and consumer requirements
• Assess, analyse, develop, document and implement changes based on requests for change
• Assess and analyse release components
• Modelling tests in coordination with testers maintaining and administering the tools and methods
• Ensuring information exchange with configuration management
• Ensure release processes and procedures are maintained
• Investigates operational needs and problems, and opportunities, contributing to the recommendation of improvements in automated and non-automated components of new or changed processes and organisation
• Defines and manages scoping, requirements definition and prioritisation activities for changes
• Investigates, manages and applies authorised requests for changes to base-lined requirements, in line with the change management policy
• Interprets installation standards to meet project needs and produces database components as required
• Evaluate potential solutions, demonstrating, installing and commissioning selected products
• Apply ethical and robust techniques in the transformation of data from one format to another, in line with organisational policies and procedures
• Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the company
• Implement processes and systems to monitor data quality, ensuring production data is accurate
• Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues
• Test the reliability and performance of each part of new and/or existing systems
• Deploying machine learning models into the production environment

Knowledge, skills and attributes

• Maintains knowledge of specific specialisms related to Data Engineering
• Demonstrate the ability to plan and organise
• Analytical mind and business acumen
• Programming in Python with demonstrable understanding of software development
• Problem-solving aptitude
• Working knowledge or Power BI to create reports, dashboards and measures
• Knowledge of augmented analytics, data visulation, data virtualisation and data governance solutions and implementations
• Excellent problem solving and troubleshooting skills
• Highly process orientated with great documentation skills
• Strong working and conceptual knowledge of building and maintaining physical and logical data models
• Strong analytical skills related to working with unstructured datasets
• Ability to manipulate, process and extract value from large, disconnected datasets
• Strong project management and organisational skills
• Ability to work under pressure and meet deadlines
• Solid understanding of database design principles
• Excellent oral and written communication skills with a keen sense of customer service
• Ability to manage and communicate data warehouse plans to internal clients
• Working understanding of major cloud platform provider (at least one of Azure, AWS, Google etc)

Academic qualifications and certifications:

• Relevant qualification (Bachelor’s in computer science, information technology or applied math or statistics)
•  Relevant certification/s, e.g. Certified Data engineer, Certified Professional, etc)

Experience required:

• Proven experience working with data engineering, data mining within a fast-paced environment
• Experience in building modern data analytics solutions tha delivers insight from complex data sets
• Solid Programming experience in Python
• Good experience working with SQL, MySQL databases and Microsoft SQL
• Experience working in internet technologies, e.g. Saas, Iaas and Paas
• Experience with big data tools like Hadoop, Cassandra, Storm, Etc
• Experience with writing scripts using scripting language (Perl, bash, Shell, Scripting, Python, etc.)
• Experience in automation, scripting and proven examples of successful implementation
• Experience with architecture and design of secure, high available and scalable systems
• Experience building modern data analytics solutions that delivers insights from large and complex data sets
• Experience with architecture and design of secure, highly available and scalable systems
• Experience working in internet technologies