Data Engineer at Ignition Group

The role  
The Data Engineer will help facilitate gathering data from a variety of different sources, in the correct format, assuring that it conforms to data quality standards and assuring that downstream users can get to that data timeously. 
Show us what you know and we’ll return the favour. Work with some of the best minds in the industry.  
The detail 
Data design  

• Designing, developing, and testing large stream data pipelines to ingest, aggregate, clean, and distribute data models ready for analysis. 

Data processing 

• Preparing data for descriptive, predictive and prescriptive modelling. 
• Automating repetitive tasks and manual processes related with the data usage. 
• Optimizing data delivery. 
• Implementing features, technology, and processes that move us towards industry best practices, improving on scalability, efficiency, reliability, and security. 

Data integrity  

• Ensuring the highest standard in data integrity. 
• Leveraging best practices in continuous integration and delivery. 
• Collaborating with other engineers, analysts, and stakeholders to produce the most efficient and valuable solutions. 
• Contributing to our data democratisation and literacy vision by making accessible and easy-to-use data products and tools. 
• Implementing features, technology, and processes that move us towards industry best practices, improving on scalability, efficiency, reliability, and security. 
• Operations and ownership of systems in production, responding to incidents. 

Are you this person?  

• Do you have a Computer Science Degree or four years relevant industry experience? 
• Have you worked on SQL for a minimum of four years? 
• Do you have a proven track record of data modelling and schema design? 
• Do you have a thorough understanding of database and data warehousing principles (e.g., OLAP, Data Marts, Star Schema, Snowflake, etc.)? 
• Have you worked on Python for one year or more? 
• Are you familiar with automated File Drops (SFTP/Email/Teams)? 
• Do you handle Automated Data Process (Processing Data from SFTP/EMAIL/Share points)?