PySpark Data Engineer at DotModus

Position Summary

We leverages the power of data, analytics, robotics, science and cognitive technologies to uncover hidden relationships from vast troves of data, generate insights, and inform decision-making. We assist clients transform their business by architecting organizational intelligence programs and differentiated strategies to win in their chosen markets.

 You will be responsible to:

• Implement large-scale data ecosystems including data management, governance and the integration of structured and unstructured data to generate insights leveraging cloud-based platforms 
• Leverage automation, cognitive and science-based techniques to manage data, predict scenarios and prescribe actions 
• Drive operational efficiency by maintaining their data ecosystems, sourcing analytics expertise and providing As-a-Service offerings for continuous insights and improvements 

Skills and experience required:

• 3+ years of relevant technology consulting or industry experience to include experience in Information delivery, Analytics and Business Intelligence based on data 
• 3+ years experience in Python and/or R
• 3+ years experience in SQL
• 3+ years experience PySpark 
• 2+ years of hands on experience with data core modernization and data ingestion. 
• 1+ years experience leading workstreams or small teams 

Preferred:

• Experience with Cloud using Amazon Web Services (AWS), Microsoft Azure, and/or Google Cloud Platform (GCP) 
• Understanding of the benefits of data warehousing, data architecture, data quality processes, data warehousing design and implementation, table structure, fact and dimension tables, logical and physical database design, data modeling, reporting process metadata, and ETL processes. 
• Experience designing and implementing reporting and visualization for unstructured and structured data sets 
• Experience designing and developing data cleansing routines utilizing typical data quality functions involving standardization, transformation, rationalization, linking and matching 
• Knowledge of data, master data and metadata related standards, processes and technology 
• Experience with Data Integration on traditional and Hadoop environments 
• Strong oral and written communication skills, including presentation skills (MS Visio, MS PowerPoint).
• Hive/presto layer
• Visualisation (Power BI)

Closing Date: 9th, July 2022