Data Engineer at RMB - Rand Merchant Bank

Job Description

Hello Future Data Engineer!

• RMB is a place where exceptional people create their own opportunities by challenging the conventional and driving sustainable impact.
• United by our proud heritage, strong ethics and philosophy of Traditional values. Innovative ideas, it’s the magic of our people and culture that sets us apart.

Now, is the time to imagine your next move with South Africa’s number one employer in Financial Services for 2023, where you can embrace the power of collective thinking to unlock unique opportunities for our clients and society.

• The Data Provisioning team is responsible for managing the process of providing access to data, ensuring that the right data is available to the right users or systems in a timely and secure manner. The team is tasked with provisioning, delivering, and maintaining data assets to meet the needs of various business stakeholders within RMB. Some of our functions involves Data Catalog and Metadata Management, Data Provisioning Automation, Data Integration and ETL Processes, and Data Access Management
• This role provides an exciting opportunity to roll out a new strategic initiative within the RMB in Data Provisioning. The Data Engineer serves as a development and support expert with responsibility for the design, development, automation, testing, support, and administration of the Data Engineering service. The role require experience with Hadoop, Relational Database Management Systems and ETL. This will involve building and supporting streaming platform utilized by our clients in data engineering community.
• The data engineer will be responsible for developing features, ongoing support and administration, and documentation for the service. The platform provides a messaging queue and a blueprint for integrating with existing upstream and downstream technology solutions.
• Our data engineers create robust and scalable computing environments which bring data-driven technologies to our users. We are constantly challenging ourselves to build more effective data architectures, flexing our freedom to incorporate new technologies and expand our computing power.

Are you someone who can:

• Develop and deploy of data applications
• Design & Implement of infrastructure tooling and work on horizontal frameworks and libraries
• Create data ingestion pipelines between legacy data warehouses and the big data stack
• Automate application back-end workflows
• Build and maintain backend services created by multiple services frameworks.
• Maintain and enhance applications backed by Big Data computation applications.

You will be an ideal candidate if you:

• Have a relevant Degree in Computer Science, Engineering, IT, Mathematics or equivalent or related field
• Minimum of 3 years experience within ETL tools such as Ab Initio and Informatica
• Ability to configure repository projects using Ab Initio EME for creating a common development environment.
• Have Knowledge of Control M to automate and schedule jobs.
• Informatica PowerCenter and EDC.
• Programming languages (SQL, XTML, Java, Python).
• Data platforms (Oracle, Teradata, Hadoop, SQL).
• Worked on Big Data platforms (Vanilla Hadoop, Cloudera, or Hortonworks).
• Experience in designing and setting up large data systems, with an ability to assess the tradeoffs in architectural decisions.
• Knowledge of large data architectures (data warehouses, lakes, meshes, etc).
• Experience with Scala or other functional languages (Haskell, Clojure, Kotlin, Clean).
• Experience with some of the following: Apache Hadoop, Spark, Hive, HDFS, ZooKeeper, Linux, Bash, version control tools, continuous integration tools.
• Experience with reporting like PowerBi.

You will have access to:

• Opportunities to network and collaborate
• Opportunities to innovate
• Working directly across RMB with developers, operations staff, data scientists, architects, and business constituents to develop and enhance the big data service.

We can be a match if you are:

• Curious & courageous - you're driven by always wanting to know more and learn more
• Obsessed with mastery - you know what it takes to become good at what you do and are constantly pushing yourself to do it