Data Engineer at Prodigy Finance

What you will do in the role

Be part of the data engineering team that is building a state of the art data platform. Responsibilities include setting up realtime and batch data / machine learning pipelines, configuring databases, and servicing data to business stakeholders.

• Be an integral and trusted member of the data engineering team
• Be a mentor to new team members
• Hands on coding / implementation to enable data to flow to our data systems from both internal and external sources
• Establish good working relationships across the tech team in order to better understand the data being created and help mould our data practices and standards
• Establish good working relationships with data consumers in order to better how they use the data and advocate how we enable them to use data more effectively and efficiently
• You take responsibility for the data and systems you both inherit and produce. Be passionate about data engineering and make our data solutions better
• Research and stay abreast of key technical developments and trends

What you will be measured on

• The integration of data sources into our data and analytics environment
• The timely delivery of quality data to our business teams
• Quality of software delivered and adherence to coding best practices
• The quality of the data we store within our data and analytics environment
• The adherence to target architecture guidelines, or your influence in changing how we architect for data integration, transformation and access
• Helping our data engineering team focus on value in order for it to be a valuable asset to the business
• Mindfulness; become aware of how your work and your behaviour impacts the wider result and the impact, not only on the platform build, but on the whole Prodigy Finance team 

What you need to be great at

• Technical competence; love coding, able to learn new paradigms quickly and look to continuously improve and find better ways of doing things
• Excellent critical judgement; able to make good decisions, be trusted, respected and dependable, be proactive and responsive, ask the right questions, raise flags at the right time, able to prioritise and plan your own individual tasks
• Mindfulness; be considerate of the implications of your work, really care about what you are doing and the impact of your contribution
• Teamwork and team spirit; we are all contributing to the same platform, so you need to not only be a great individual contributor but be more motivated by the achievements of the whole team - we only win if the team wins, see the impact of your own work and positively influence and help the work of others
• Getting up to the front of the bus; get stuck in, execute, generate ideas, have an impact, don’t just sit back and be a passenger

Who we are looking for; track record must haves

• 3+ years experience within software engineering
• Python and SQL experience
• Experience with relational database administration
• Experience working with data pipelines and messaging systems (e.g. RabbitMQ, SQS)
• Experience working with Cloud Platforms such as AWS or Azure
• Experience with software application development in a production environment
• Understand software design principles and best practices (TDD, continuous deployment, etc.)

Experience that would be nice to have (but we’ll trade off if everything else fits)

• Experience working in a data engineering team
• Experience with AWS tools (eg: Redshift, Kinesis, ECS, S3, Lambda)
• Experience with Data Warehousing and ETLs
• Experience working with Postgres
• Solid foundational knowledge of Data Science and Business Intelligence