Jobs Career Advice Post Job
X

Send this job to a friend

X

Did you notice an error or suspect this job is scam? Tell us.

  • Posted: Apr 4, 2025
    Deadline: Not specified
    • @gmail.com
    • @yahoo.com
    • @outlook.com
  • Liquid Thought was founded by its CEO, Zulfiq Isaacs in 2001. Over the past 15 years, we’ve earned a reputation as a leading digital partner of choice for many leading brands in South Africa. As a strategy-led digital innovation agency, we’ve always partnered with our Clients to grow their business and enable them to compete more effectively in the onlin...
    Read more about this company

     

    Senior Data Engineer

    ABOUT THE ROLE:

    • Be a part of building a ground-breaking, scalable, future-fit technology platform that changes lives by helping young first-time work-seekers find jobs and work experiences. You will work as a technical specialist, aiding your colleagues in the creation, maintenance and use of the data stack.

    OBJECTIVE:

    • The Senior Data Engineering role's objective is collecting, storing and processing large sets of data, with the primary goal of providing optimal solutions to use and of course the implementation, improvement, and monitoring thereof.
    • Cloud-Native technology stack is predominantly hosted in Google Cloud Platform with services written in .Net Core and Python.
    • Responsible to partner with the Head of Data on database design and strategy to enable our client's future strategy and technology roadmap.
    • Ultimately using the Power of Big Data to help them find their first job, run an Agile Development Programme in a DevOps Infrastructure and culture.
    • Data landscape includes MYSQL, Big Query and Composer; this technology stack is currently being revised to drive a strategy of simplification, business user enablement and data integrity. 

    JOB DESCRIPTION:

    • You will work as a technical specialist, aiding your colleagues in the creation, maintenance and use of the data stack.

    PLANNING AND STRATEGY:

    • Engage with various stakeholders to understand the business and data goals in context of our client's strategy and vision.
    • Design data solutions for real-time and batch environments.
    • Document the planning, implementation and operation of the data platform.
    • Select and integrate any big data tools and frameworks required to enable the business and data analysis goals.
    • Work closely with the data analyst, testers, developers and business analysts to design and ensure delivery of data requirements.

    EXECUTIVE:

    • Assist with and advise on the data platform and its use, including data analysis, security, architecture and modelling.
    • Ensure effective infrastructure for processing large volumes of transactional data.
    • Implement data retention policies.
    • Monitor performance and advise on necessary infrastructure changes.
    • Work with platform developers to ensure seamless and optimal data ingestion.
    • Build data structures and pipelines that ensure the storage and transformation of data.
    • Work with the data analysts to ensure necessary and accurate data is available for downstream use.

    SUPPORT:

    • Support other teams with ad hoc data analysis to derive business insights.
    • Support the Data analysis and Business Intelligence team on data validation and quality assurance to ensure accurate dashboards and reports.

    MINIMUM REQUIREMENTS:

    • Degree or Diploma in Science or Engineering (Mathematics, Statistics, Computer Science or related field).
    • Minimum 8 - 12 years experience as a Data Engineer.
    • Knowledge of and use with data tools and languages.
    • SQL proficiency
    • Document stores
    • Realtime and batch processing
    • Models and relationships
    • Large scale ETL (Apache beam or Apache spark, SSIS).
    • Cloud experience (Google Cloud Platform, Azure, or AWS).
    • Python
    • MySQL
    • R (nice to have)

    COMPETENCIES

    • Comfortable explaining data models, data structures and analytical findings to technical and non-technical audiences.
    • A passion for knowledge sharing and upskilling other team members.
    • Highly detail oriented.

    Check how your CV aligns with this job

    Method of Application

    Interested and qualified? Go to Liquid Thought on www.careers-page.com to apply

    Build your CV for free. Download in different templates.

  • Send your application

    View All Vacancies at Liquid Thought Back To Home

Career Advice

View All Career Advice
 

Subscribe to Job Alert

 

Join our happy subscribers

 
 
 
Send your application through

GmailGmail YahoomailYahoomail