Data Streaming Engineer at IQbusiness

Responsibilities and KRA’s           

Operational Delivery 

• Build, enhance, and maintain our real-time data pipeline
• Work with various infrastructure and operations teams to maintain our data infrastructure
• Be self-driven in identifying and documenting feature gaps, and designing and implementing solutions to them
• Help build, modernize, and maintain services and tooling to ensure resiliency, fix data discrepancies, and enhance the customer experience
• Monitor daily execution, diagnose and log issues, and fix pipelines to ensure SLAs are met with internal stakeholders
• Mentor other engineers and help them grow; code reviews, guidance on best practices, leveraging your experience in the field

Technical Leadership 

• Participate in the engineering and other discipline’s community of practice
• Share AWS knowledge and practical experience with community
• Challenge and contribute to development of architectural principals and patterns Compliance 
• Ensure solutions adhere to existing patterns, guidelines and standards
• Operate within project environments and participate in continuous improvement efforts Delivery Management 
• Follow and participate in defined ways of work including, but not limited to, sprint planning,
• backlog grooming, retrospectives, demos and PI planning

Requirements   

• Experience of developing solutions in the cloud
• At least 2-3 years' experience with designing and developing streaming Data Pipelines for Data Ingestion or Transformation using AWS technologies
• Experience with distributed log systems, such as Kafka and AWS Kinesis redPanda or Confluence experience advantageous
• Experience in developing data warehouses and data marts
• Experience in Data Vault and Dimensional modelling techniques
• Experience working with automated data warehousing solutions would be advantageous

Qualifications 

• Bachelor’s Degree in Computer Science or similar fields like Information Systems, Big Data, etc.
• AWS Data Engineer Certification would be advantageous
• Related Technical certifications