Data Engineer at ClearScore

Description
At ClearScore we believe understanding data is key to understanding our customers, and it’s this understanding that will unlock our ability to build great products. We are looking for a Data Engineer to join the team to help us build a world class data platform which enables the team to access to the data they need to guide their decisions and actions every day. You’ll be helping us solve data challenges across a range of systems, from real-time event streams powering our CRM and other data integrations to traditional batch workloads underpinning our warehouse and machine learning models.

Why ClearScore?
ClearScore is currently the biggest marketplace for credit products in the UK, South Africa and Australia with million of users. We were the first business to offer free credit reports. We did so because we are user-centric at our core and believe in leveraging our technology to enable positive financial choices. We are design-led and data driven and we embed these behaviours in everything we do.

Our company culture is a fundamental part of all we have achieved. We believe in hiring smart, driven, passionate and diverse people who are keen on having a real impact in our organisation. We trust you to manage your own time, so we offer flexible work and no fixed desk hours. We don't micromanage and we believe in measuring outcomes rather than effort. We have an inclusive culture where all, regardless of seniority, are encouraged to contribute with their ideas, look after their wellbeing and actively seek opportunities for career growth.

If you feel like this could be the place for you, apply and our Talent team will be happy to share more.

The Challenge
Over the last couple of years, we managed to build a complex, end to end data platform that powers many use cases across Clearscore. As the company continues to grow, we’re looking to make it more robust, scalable and efficient, to make sure it scales with the business. To help make this happen, you will be responsible for:

• Automating the ingestion of data from internal and external sources into our data warehouse (Amazon Redshift)
• Data cleansing and preparation using Airflow and Spark (either in Scala or Python)
• Building and maintaining daily ETL jobs
• Creating structured tables in the data warehouse to make the data clear, understandable and accessible to analysts and team members
• Writing scripts to automate the ingestion of daily reports into the data warehouse

Requirements

• Proficiency with Python, Java or Scala
• Experience of data orchestration using tools such as Airflow or similar
• ETL experience using Spark, with Scala or Python, and experience of EMR
• Knowledge of the end to end data pipeline, with a focus on data cleaning, structuring and transformation
• Understanding of AWS data stack preferred (S3, MSK, EMR, Glue, Redshift, Lambda, Kinesis)
• A certification or bachelors degree in computer science, data analytics, big data or similar
• 3+ years experience as a data engineer or similar
• An analytical mind with an eye for detail and demonstrated history of solving complex data challenges

Benefits

• Holidays – 20 paid holidays (plus public holidays) and a “duvet day” on your birthday
• Pension
• Medial Aid Benefit
• Generous training and development budget
• Flexible work hours and the ability to work from home
• Flexible, generous and personalised maternity and paternity plans
• Monthly team events and office days out that we get to choose, and company events at the end of each quarter and retro

Inclusion & Privacy Policy
We are always looking for talented individuals to join ClearScore. We are an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for our people. Please see our People Privacy Notice at https://www.clearscore.com/za/people-notice