Senior Data Engineer - Cape Town at AnyVan

• Our data engineering team are on a mission: To build a secure, resilient and cost-effective data platform that makes it possible for everyone to be an analyst.
• We're at the beginning of our data journey so this is an exciting opportunity to help us shape and mould great data practices with some super smart colleagues in a dynamic, fun business.
• We want everyone in the business to be able to make best in class data driven decisions that support our growth. We're pragmatic and open mind about introducing new tools that will drive efficiencies and look to look to simplify processes and prioritise automation to enable the business to quickly adapt to changing needs.

Some of your daily responsibilities will include the following:

• Design, implement and maintain (monitoring, alerting, incident resolution) a Data Warehouse
• Administer tools and systems (security, access control, performance)
• Help Software Engineering Teams understand how the features they release perform over time
• Help the BI team in their journey to promote self-service datasets for key business areas
• Automation through Infrastructure As Code and scripting
• Data quality and consistency data standardisation, documentation and user onboarding
• Ingestion of new data sources to our data warehouse

Here are some of the tools and technologies you will use;

• Fivetran, Snowflake, dbt, Tableau, Airflow, Python, AWS Services (Fargate, S3, IAM, Secrets Manager, Cloudwatch, to name a few), Terraform, CircleCI, Github, Docker, Datadog, Jira, Confluence, Slack, Google Suite.

Skills and experience we think you'll need to be successful in the role;

• Strong proficiency in SQL for data manipulation and query optimization.
• Experience running Data Platforms to support Production workloads
• Adequate coding skills in languages such as Python, Java, or Scala.
• Designing, building, and maintaining ETL/ELT pipelines.
• Understanding of data modeling, normalization, and schema design.
• Strong understanding of Git
• Experience working with Cloud Platforms (AWS preferred but not mandatory)
• Understands Infrastructure As Code (Terraform preferred but not mandatory)
• Experience of Data Security best practices and Data Privacy laws