Senior Data Engineer at Paracon

The Role;

• You will be responsible for the infrastructure that provides insights from raw data, handling and integrating diverse sources of data seamlessly.
• Enabling solutions, by handling large volumes of data in batch and real-time by leveraging emerging technologies from both the big data and cloud spaces. 
• You will be building and supporting data pipelines and building data marts off those pipelines. 
• You will have to use your knowledge of data analysis, end-user requirements and business requirements analysis to develop a clear understanding of the business need and to incorporate these needs into a technical solution.

To apply, you need to have a 3-year IT Degree/Diploma and an AWS Certification (Associate level).

You need to have 5+ years’ Business Intelligence experience, 2+ years’ Big Data experience, 5+ years’ experience working with Extract Transform and Load (ETL) processes, and 2+ years’ Cloud AWS experience.

You also need at least 2 years’ Agile exposure (Kanban/Scrum) and it will be beneficial if you have Retail Operations experience and experience working as a Technical Lead in the relevant area.

Your experience must cover the following:

• Creating data feeds from on-premise to AWS Cloud (2 years);
• Supporting data feeds in production on a break-fix basis (2 years);
• Creating data marts using Talend or similar ETL development tool (4 years);
• Manipulating data using Python and Pyspark (2 years);
• Processing data using the Hadoop paradigm particularly using EMR, AWS’s distribution of Hadoop (2 years);
• DevOps for Big Data and Business Intelligence including automated testing and deployment (2 years);
• Further technical skills required:
  • Talend;
  • AWS (EMR, EC2, S3);
  • Python;
  • PySpark or Spark - Desirable;
  • Business Intelligence Data modelling; and,
  • SQL.