Senior Data Engineer: BluNova at Blue Label Telecoms

Job Purpose

Manager of multiple Front-Line Managers in the field of Data Management.

RESPONSIBILITIES

Data Architecture & Design

• Design and develop robust and scalable data architectures that align with business needs and ensure data integrity, reliability, and security
• Define data models, schemas, and data storage strategies to support various data types (structured, semi-structured, unstructured) and optimize data retrieval and analysis
• Use data from a wide range of sources to analyze key themes and identify possible impacts on the business

Data Pipeline Development & Management

• Build and maintain scalable, efficient, and fault-tolerant data pipelines to extract, transform, and load (ETL) data from various sources into data storage systems (e.g., data warehouses, data lakes)
• Implement data quality checks, error handling, and monitoring mechanisms to ensure data accuracy and consistency
• Manage key aspects of the data management system

Data Integration & Transformation

• Integrate and transform data from disparate sources, including databases, APIs, logs, and external data feeds, to create unified and standardized datasets
• Develop and implement data transformation and normalization processes to ensure data is clean, consistent, and ready for analysis
• Work within established knowledge management systems to deliver pre-set outcomes for area of responsibility

Performance & Cost Optimisation

• Identify and implement performance optimization techniques to enhance data processing speed, reduce latency, and improve overall system efficiency
• Optimize data storage and retrieval mechanisms, including indexing strategies, partitioning, and compression techniques
• Uncover emerging issues or needs, identifying potential causes, barriers and key stakeholders as well as related issues

Collaboration & Leadership

• Collaborate with cross-functional teams, including data scientists, software engineers, and business stakeholders, to understand use case, data requirements and deliver data solutions
• Mentor and provide guidance to junior data engineers, fostering a culture of learning, innovation, and continuous improvement

Data Security & Governance

• Ensure data privacy and security by implementing appropriate access controls, encryption mechanisms, and data anonymization techniques
• Collaborate with stakeholders to define and enforce data governance policies, standards, and best practices
• Identify and evaluate complex, expertise-led solutions against a range of criteria to find the ones that best meet business needs

Performance Management

• Develop and propose own performance objectives
• Take appropriate actions to ensure achievement of agreed objectives, using the organization's performance management systems to improve personal performance
• Manage and report on team performance
• Set appropriate performance objectives for direct reports or project / account team members and hold them accountable for achieving these, taking appropriate corrective action where necessary to ensure the achievement of team / personal objectives

Requirements

Behavioural Competencies

• Optimizes Work Processes
• Manages Complexity
• Tech Savvy
• Communicates Effectively
• Collaborates
• Strategic Mindset

Skills

• Computer Skills
• Data Collection and Analysis
• Action Planning
• Data Control
• Compliance Management

Education

• University / Post Graduate (Masters Degree)

Experience

• Substantial general work experience together with comprehensive job related experience in own area of expertise to fully competent level. (Over 6 years to 10 years )
• Experience of supervising and directing people and other resources to achieve specific end results within limited timeframes (13 months to 3 years)