Software Engineer - Big Data Analytics Platform at MECS (Pty) Ltd

• Responsible for the requirements, design, development, testing and documentation of new and legacy data ingestion, integration, processing, and storage software to meet the requirements of the company's IoT Platform Solution.
• This IoT solution is a big data analytics platform for the mining industry which requires a focus on collecting, processing, contextualising, and managing data assets thus turning it into information, and finally leveraging this information to address the 4 pillars of analytics - descriptive, diagnostic, predictive, and prescriptive.

Responsibilities:

• Data ingestion
• Data integration
• Data processing
• Data storage
• Digital twin management
• Data management and governance

Experience and Qualifications:

• Bachelor’s degree in computer/software engineering, computer science
• Masters or doctoral level degree (advantageous)
• 2-5 years’ experience in computer science, software, or computer engineering, applied math, physics, statistics, or related fields.
• Experience with wireless and network communication technologies such as Wi-Fi, GSM, LoRaWAN, Bluetooth, TCP/IP.
• 2-5 years’ experience with data lake and warehousing solutions.
• 2-5 years’ experience with either Python, Java, C++, C#, Sparql , SQL databases.
• 2-5 years’ experience with either Apache Kafka (producers/consumers/connectors), Apache NiFi, Apache Spark, Apache ActiveMQ, MQTT, Modbus, REST API.
• Experience with developing, building and releasing of containerised services and microservice architectures using Docker.
• Experience within big data platforms, structured, unstructured and semi-structure data management.
• Experience with data analytics, machine learning and AI (advantageous)
• Experience with workflow management tools and BPMN eg. Camunda (advantageous)
• Experience with distributed systems and cluseter orchestration systems such as Kubernetes.