Jobs Career Advice Signup

Send this job to a friend


Did you notice an error or suspect this job is scam? Tell us.

  • Posted: May 22, 2020
    Deadline: Not specified
  • We are a specialist recruitment agency with a team of experts who have years of experience in the recruitment industry and are aware of issues which arise in todays corporate world. Hence, we make it our priority to find paramount talent by using the most effective and efficient methods to make the process smooth and professional to ensure the longevity a...
    Read more about this company

    Hadoop Infrastructure (Admin) Engineer

    You have the following technical competencies

    • Hadoop 3 or Hive 3
    • Responsibility for supporting, configuring, upgrading, and maintaining multiple Hadoop clusters.
    • Configure and Deploy Apache Hadoop and other Apache components from scratch on VMs, Docker, and/or Kubernetes.
    • Configure and Deploy Hiveserver LLAP on bare metal or Docker/K8
    • Installation / Setup
    • Yarn using the Capacity and Fair Scheduler
    • Performance tuning and scaling Hiveserver LLAP using TEZ in a production environment
    • HDFS HA
    • Spark 2.4
    • Spark Warehouse Connector
    • Ranger 2.0
    • Atlas 2.0
    • Installation / Setup of Hadoop in Linux environment
    • Deployment in a Hadoop cluster and its maintenance
    • Health checks of a Hadoop cluster, monitoring whether it is up and running all the time
    • Analyse the storage data volume and allocating the space in HDFS
    • Resource management in a cluster environment
    • Responsibility for supporting, configuring, upgrading, and maintaining multiple Hadoop clusters.

    You have knowledge and/or experience with the following concepts
    Hadoop EcoSystem

    • Apache Hadoop
    • Apache Spark
    • Apache Hive
    • Apache Zookeeper
    • Apache Solr

    Understanding Integration features

    • Apache Atlas
    • Apache Ranger
    • Apache Zeppelin
    • Writing high-performance, reliable and maintainable modular code
    • Data pipelining knowledge - data extraction and transformation
    • Knowledge of the MapReduce and related data processing paradigms
    • Hands on experience in HiveQL
    • Hadoop development and implementation.

    You have the following personal competencies

    • The ability to solve problems
    • The ability to rotate around a problem, to see if solutions can be gained in different ways
    • The ability to work in an ever changing, unstructured environment
    • The ability to work as part of a team, with vastly differing skill sets and opinions.
    • The ability to contribute ideas to the quorum
    • The ability to mentor and provide guidance for other team members
    • A systems approach to thinking, as opposed to a siloed approach. The candidate needs to understand how their work affects the greater system
    • The ability to work without supervision, and take accountability for the work they deliver
    • The ability to liaise with a client, sifting through the fluff and extracting the actual requirements.

    Method of Application

    Interested and qualified? Go to SUMMIT Africa Recruitment on to apply
  • Send your application

Never miss a job with our real-time & personalized push notification
Subscribe Now
Back To Home

Career Advice

View All Career Advice

Subscribe to Job Alert


Join over 920 happy subscribers

Send your application through

Yahoomail Gmail Hotmail