Data Engineer - SAP HANA (6 months contract renewable) at TotalEnergies

Job Description

As a Data Engineer you would be responsible for the following: 

Functional Expertise:

• Provide functional expertise and guidance around leveraging the capabilities of data engineering platforms to business stakeholders.
• Act as liaison between business key users and the Digital & Data department - for investigating, analysing, and implementing cloud based data engineering solutions (including documenting, data mapping, analytical processing and source system modifications).

Solution Development:

• Produce end-to-end solutions for new and existing Data Engineering projects including delivery of configuration enhancements from concept to solution and the design and implementation of data models.
• Development of data manipulation services (e.g. machine learning, stored procedures, USQL, TSQL, ETL, scripting (Python or Scala) etc).
• Run proof of concepts and investigate opportunities for use of innovative cloud solutions.

Solution Support:

• Manage complex incident resolution on productionised data engineering solutions (root-cause analysis, problem statements).
• Responsible for ensuring the production services are optimally configured and aligned to best practices to protect production data.
• Support the development of automated Business Intelligence reports and Data Science projects in conjunction with business stakeholders and other members of the Digital & Data department.
• Work in close collaboration with IS to define and develop the industrialised Data Engineering support process which will be managed and administered by IS.

Data Strategy:

• Assist in the definition of the data engineering strategy, solutions and roadmaps, ensuring they meet both business and performance goals in line with the Total IT strategy and Data Governance guidelines
• Design, develop, and implement end-to-end data solutions (storage, integration, processing, access) in AWS or equivalent
• Architect and support the development of automated data pipelines (ETL, ELT) in conjunction with business stakeholders.
• Analyse and define data architecture requirements by evaluating business processes and existing data structures and applications.
• Propose architectures that consider cost/spend in AWS or equivalent and develop recommendations or plans to right-size data infrastructure
• Analyse and define data architecture requirements by evaluating business processes and existing data structures and applications
• Identification of new Data Engineering techniques, tools or best practices and assist in integrating them into the Digital & Data department’s ways of working.
• Design and implement data models to document the data architecture in its AS-IS and TO-BE states.
•  Assist in the definition of a Cloud Data strategy, solutions and roadmaps, ensuring they meet both business and performance goals in line with the TotalEnergies IT strategy and Data Governance guidelines.
• Identification of new digital techniques, tools or best practices and assist in integrating them into the Digital & Data department’s ways of working.

Context and environment

• Data Engineering is an emerging discipline which can help facilitate the utilisation of data as an asset within TMSA.
• The development of robust and reusable data engineering solutions is required to support the long term goals of the Digital & Data department.
• The Data Engineer will be part of the team responsible for the specification, building and maintenance of new requirements for TMSA data engineering platforms and thereafter the transfer of support for these platforms to the IS organisation
• The Data Engineer must be able to effectively work with key business users and IS colleagues within TMSA to provide a high-quality data engineering solution, in addition provisioning subject matter expert (SME) best practice guidance across the domain.
• The Data Engineer must also be able to effectively work with centralized teams at Total Group to ensure the solutions delivered within the affiliate align to Group standards and procedures.

Candidate profile

Ideally, a Data Engineer you would possess the following: 

• A numerate honours degree (e.g. Computer Science, Mathematics, Engineering) with minimum 5 years of industry experience.
• Ability to develop functional specifications for business requirements.
• Knowledge of leading technologies including:
• Enterprise data modelling
• Data ingestion and integration
• Data storage and security
• Data processing and distributed computing
• Software engineering principles and application architectures
• Hardware infrastructure and networking
• Experience writing robust, reusable code to create production-strength data pipelines
• Excellent knowledge of Unix scripting and one of C#, Python, Java or Scala.
• The ability and motivation to learn new programming languages and techniques when necessary.
• Extensive experience working with relational databases, including database administration.
• Knowledge of distributed computing, data and application architectures, basic networking, security and infrastructure
• Proven production experience and best practice knowledge of cloud platforms, features, and capabilities (AWS components)
• Proven production experience and best practice knowledge of Azure Data Factory & Amazon Data Pipeline\\ Glue\\Redshift
• Knowledge of best practice principles behind cloud-based data ingestion, storage and associated data transformations.
• Demonstrable experience of modern ETL technologies and packages, including Upstream enterprise platforms
• Experience integrating cloud services to work with on premise data sources and clients.
• Excellent interpersonal, communication skills, written and verbal combined with effective technical presentation skills.
• Organised, methodical and able to multi-task whilst working under tight deadlines

Preferred:

• A thorough understanding of the Downstream industry and knowledge of Downstream companies main strategic drivers.
• Knowledge of multi-tier, high availability, cloud and on-premise data engineering solutions in a complex multi-site enterprise environment.
• Experience of working within a Power BI based reporting environment.
• Experience of working within a dynamic Agile based team.
• English language proficiency.