Senior Data Engineer at NTT Ltd.

• The Senior Data Engineer is responsible for designing, building, and maintaining scalable data pipelines.

Key Responsibilities:

• Design and implement robust, scalable, and secure data pipelines (ETL/ELT).
• Build and maintain data warehouses, data lakes, and real-time streaming systems.
• Develop and optimize workflows for large-scale data processing.
• Manage and maintain data environments, including performance tuning and cost optimization.
• Collaborate with data scientists, analysts, and business stakeholders to understand data needs.
• Ensure data quality, integrity, and compliance with data governance and privacy regulations (e.g., POPIA, GDPR).
• Mentor junior engineers and contribute to best practices and code reviews.
• Automate data validation, monitoring, and alerting processes.
• Integrate data from various sources including APIs, databases, and third-party platforms.
• Directs test scenarios and is responsible for participating in thorough testing and validation to support the accuracy of data transformations.
• Works across multiple IT and business teams to define and implement data table structures and data models based on requirements.
• Works with various stakeholders to evaluate potential data requirements.
• Networks with various stakeholders, contributing to the recommendation of improvements in automated and non-automated components of the data tables, data queries and data models.

Knowledge and Attributes:

• Advanced knowledge of the definition and management of scoping requirements, definition and prioritization activities.
• Advanced understanding of database concepts, object and data modelling techniques and design principles and conceptual knowledge of building and maintaining physical and logical data models.
• Advanced expertise in Microsoft Azure Data Factory, SQL Analysis Server, SAP Data Services, SAP BTP. Snowflake and Databricks
• Advanced understanding of data architecture landscape between physical and logical data models
• Analytical mindset with excellent business acumen skills.
• Problem-solving aptitude with the ability to communicate effectively, both written and verbal.
• Ability to think strategically and build effective relationships at all levels within the organization.

Academic Qualifications and Certifications:

• Bachelor's degree or equivalent in computer science, software engineering, information technology, or a related field.
• Relevant certifications preferred such as SAP, Microsoft Azure, Snowflake and Databricks.
• Certified Data Engineer, Certified Professional certification preferred.

Required experience:

• Proficient in building modern data analytics solutions that delivers insights from large and complex data sets with multi-terabyte scale.
• Advanced demonstrated experience with architecture and design of secure, highly available and scalable systems.
• Advanced proficiency in automation, scripting and proven examples of successful implementation.