IQbusiness is the largest independent management consulting firm in South Africa. Since 1998, we have helped our clients solve their problems by providing innovative, fast and cost-effective solutions. Our methods and frameworks, drawn from our 20 years of international and local experience, allow us to deliver client value early and continuously
Read more about this company
As an AWS Cloud Data Engineer, you will be responsible for building high-quality, innovative, and fully performing data solutions.
You will collaborate closely with cross-functional teams, including business stakeholders, data scientists, and IT professionals, to ensure accurate and actionable insights are provided.
Some of your duties include:
Develop data ingestion, data processing, data engineering, and analytical pipelines for big data, relational databases, NoSQL, and data warehouse solutions.
Utilise public cloud architectures, considering pros/cons and migration considerations.
Implement AWS and Big Data technologies such as AWS EC2, AWS S3, AWS Lambda, Spark/SparkSQL, and streaming technologies like Apache Kafka, AWS Kinesis, and Apache NiFI.
Use programming languages such as Java, C#, Node.js, Python, PySpark, SQL, and Unix shell/Perl scripting.
Work with DevOps tools like GitHub, GitLab, Jenkins, CodeBuild, CodePipeline, and CodeDeploy.
Follow Agile software development and DevOps best practices and principles.