Senior Data Engineer at NMG Benefits

SUMMARY STATEMENT

• We’re looking for a curious, intelligent, and proactive cloud focused Senior Data Engineer to help us tackle complex data analytics projects end-to-end in Microsoft Azure. You will work with various teams based in multiple locations globally to deliver solutions on the Azure Cloud using core Azure cloud tools and languages. In addition, you will participate in improving recent implementations. You’re committed to delivering high quality interactions and you’re excited about making a big impact on a small team.

KEY RESPONSIBILITIES

Success in this role will see the following achieved:

Data Architecture

• Participate in deep architectural discussions to build confidence and ensure customer success when building new solutions and migrating existing data applications on the Azure platform.
• Reverse engineer existing database data models, manage and maintain existing and new logical and physical data models.

Data Engineering (Development)

• Collaborate with functional group leaders and engineering team(s) to gather and analyse business and technical data requirement needs and understand how data is collected, analysed & utilised to design and implement the management, monitoring, security, and privacy of data using the full stack of Azure data services.
• Design and build Microsoft Azure functions to optimize data extractions and ensure data validation, cleansing and merging forms a critical part of data processing solutions.
• Ensure that data services securely and seamlessly integrate with other data platform technologies or application services such as Azure Cognitive Services, Azure Search, or even bots.

Testing

• Perform unit, integration, or system testing (automated or otherwise) on all developed code and / or system components through stringent routines and procedures to ensure accuracy and solution integrity and that solutions run smoothly with optimum operational efficiency, ensuring all solutions will meet SLAs & performance criteria.
• Provide feedback on solutions’ usability, features, and design based on results of testing.

Production Support and Maintenance:

• Provide exceptional support by applying critical thinking skills to troubleshoot, determine the cause of failure, and quickly restore failed components or processes when they occur; Diagnose and remediate resource contention issues and failures in application logs.
• Participate in an on-call rotation with the team, when necessary, specifically related to customer-facing digital cloud solutions.

Training and Mentorship:

• Provide technical training and mentoring to other teams and team members and organize and execute training sessions for the user base of in-house developments for new workflows, procedure recommendations, the availability of data in operational data stores as well as the data warehouse and how to consume the data effectively in business intelligence and analytics tools withing the organization.

YOUR EXPERIENCE

The successful candidate for this role will be able to demonstrate:

• Data Factory, Functions, Resource Manager Templates, Storage Accounts, Notifications Hub, Key Vault, DevOps, Data Lake Stores, Data Lake Analytics, Synapse Analytics, Databricks, HD Insight, SSAS, SQL Database or similar cloud infrastructure (5+ years’ experience and deep expertise in data engineering as applied to Azure preferred), including Visual Studio as applied to SSAS development.
• In-depth knowledge of standard concepts, practices and procedures related to database modelling (logical and physical) and management, concepts of data lakes, data warehousing and data marts as well as legacy migrations to cloud services.
• Infrastructure automation for continuous integration and continuous deployment of technical solutions leveraging Azure Services and Features.
• Hands-on experience in scripting languages such as Python, R, etc.
• Modern version control Git, SVN, TFS, etc.

ADVANTAGEOUS EXPERIENCE

• Advanced Business Intelligence experience, understanding of BI areas and reporting using SQL, SSAS, Tabular Models and Power BI, including proactive identification of issues and coordination of resolutions.
• Applicable Azure certifications including for example Implementing an Azure Data Solution, Designing an Azure Data Solution, Designing and Implementing Microsoft DevOps Solutions.
• Familiarity with the Technology stack available in the industry for data management, data ingestion, capture, processing, and curation as well as metadata management: data governance, data quality, master data management, lineage, data cataloguing, etc.
• Being able to conceptualize the full project life cycle.
• QA testing