Data Engineer at Lulalend

OVERALL PURPOSE

• We are looking for a Data Engineer to join our team. You will be tasked with implementing and maintaining data models with the goal of improving data reliability and quality, ensuring scalable data pipelines are working smoothly, and bugs and performance issues are quickly identified.
• As a member of the Data Science team, your primary focus will be to combine raw information from different sources to create consistent and consumption-ready formats. More specifically, you will need to construct and test architectures that enable data extraction and transformation for predictive or prescriptive modelling.

Responsibilities will include:

• Developing and maintaining scalable data pipelines and systems
• Monitoring production runs to ensure accurate and timely delivery of data
• Collecting, analysing, and organising raw data from multiple sources
• Collaborating with Data Scientists on various projects
• Building features and creating customised datasets for machine learning algorithms
• Assisting with planning, building, and maintaining the Data Warehouse
• Improving data quality and reliability
• Developing and maintaining APIs hosted by the Data Science team with high uptime
• Creating new API integrations as needed for increasing data volume and complexity
• Writing tests, documenting work, and refactoring code to maintain a clean data engineering repository
• Building reusable classes to speed up the development of data science projects
• Collaborating with other teams (e.g. software engineering, product management) to understand data needs and requirements
• Keeping up-to-date with industry trends and emerging technologies in data engineering and data science

THE COMPETENCIES WE’RE AFTER

• Clear and concise communication and documentation skills
• Process orientated with experience in Agile
• Team-player with a desire to collaborate
• Critical thinking skills
• Focused on high quality output
• Self-starter

THE SKILLS AND EXPERIENCE WE’RE LOOKING FOR

• Bachelor's degree in Computer Science, IT, or related field
• 4+ years experience as a Data Engineer or in a similar role
• Experience in Azure cloud environment preferred
• Experience with data visualisation tools, particularly Mixpanel, is a plus
• Data engineering certification, such as Microsoft Certified Azure Data Engineer, is an advantage
• Proficiency in Python and relevant data packages
• Experience with PostgreSQL/MS SQL databases
• Understanding of schema design and data modelling
• Experience with data shipment via ETL, APIs, etc.
• Familiarity with source code and version control