Senior Data Engineer at TMF Group

Job Purpose

• Experience in building highly scalable, reliable and self-heal data pipelines to process large datasets
• Deep understanding of Data Structures and algorithms
• Experience with relational SQL and NoSQL databases
• Strong hands on experience with SQL incl advanced SQL
• Experience with stream-processing systems: Storm, Spark-Streaming, etc.
• Experience in building operational ETL data pipelines from a number of disparate sources
• Strong working experience with SSIS / ADF / DataBricks
• Experience with Spark and other distributed processing frameworks.
• Understanding of code management, CI/CD concepts and their application in the Big-data universe
• Experience with public cloud architectures, pros/cons, and migration considerations
• Experience in implementing solutions for Master Data Management
• Experience in Agile development methodologies
• Proven leadership capabilities, the ability to influence others, interpersonal skills, and problem solving skills
• Microsoft Azure certifications are a plus.