AWS Data Engineer (Cape Town) at IQbusiness

Job Description

About You and the Key Skills We’re Looking For

• Your proven record as an AWS Cloud Data Engineer highlights your expertise in creating scalable and secure data solutions. Proficiency in AWS and Big Data technologies such as AWS EC2, AWS S3, AWS Lambda, and Spark/SparkSQL enables you to handle massive amounts of data efficiently.
• Your adeptness with programming languages like Java, C#, Node.js, Python, and SQL ensures robust and innovative solutions.
• Your comprehension of cloud-based infrastructure and DevOps tools underscores your holistic approach.
• Your familiarity with data integration, enterprise data warehousing, and data visualisation enhances your technical edge for this role.

Key Responsibilities

• As an AWS Cloud Data Engineer, you will be responsible for building high-quality, innovative, and fully performing data solutions. You will collaborate closely with cross-functional teams, including business stakeholders, data scientists, and IT professionals, to ensure accurate and actionable insights are provided.

Some of your duties include:

• Develop data ingestion, data processing, data engineering, and analytical pipelines for big data, relational databases, NoSQL, and data warehouse solutions.
• Utilise public cloud architectures, considering pros/cons and migration considerations.
• Implement AWS and Big Data technologies such as AWS EC2, AWS S3, AWS Lambda, Spark/SparkSQL, and streaming technologies like Apache Kafka, AWS Kinesis, and Apache NiFI.
• Use programming languages such as Java, C#, Node.js, Python, PySpark, SQL, and Unix shell/Perl scripting.
• Work with DevOps tools like GitHub, GitLab, Jenkins, CodeBuild, CodePipeline, and CodeDeploy.
• Follow Agile software development and DevOps best practices and principles.