Data Engineer at PBT Group

Job Description

• We are looking for a versatile Data Engineer with a strong blend of data engineering and software engineering skills. The ideal candidate is someone who thrives on improving existing systems, enjoys business-as-usual (BAU) operational tasks, and is comfortable engaging with business stakeholders to understand and translate requirements into technical solutions.
• This is not a greenfield development role — instead, it focuses on supporting, maintaining, and optimising our current data and backend solutions to ensure performance, stability, and scalability.

Key Responsibilities:

• Monitor and support existing data pipelines and backend processes to ensure smooth daily operations.
• Investigate and resolve issues related to databases (e.g., performance tuning, index management, RDS memory optimisation).
• Analyse and fix API-related errors, latency issues, and general data integration problems.
• Optimise SQL queries, functions, and stored procedures as needed.
• Conduct load testing and scenario testing to ensure robustness and reliability of solutions.
• Collaborate with business users to gather and understand requirements, then translate them into scalable technical solutions.
• Make incremental improvements to existing systems — including data models, ETL processes, and reporting solutions.
• Contribute to backend work and system maintenance where applicable.
• Maintain clean documentation and follow good development practices, ideally with some GitOps experience (not mandatory).

Key Skills and Experience:

• 4+ years of experience in data engineering, software engineering, or related roles.
• Strong understanding of relational databases (e.g., PostgreSQL, MySQL, AWS RDS).
• Proficiency in SQL and Python for data processing and scripting.
• Solid troubleshooting skills with experience in diagnosing system performance issues and debugging backend systems.
• Comfortable working in a BAU environment, making enhancements to existing systems rather than building from scratch.
• Ability to work closely with business stakeholders to spec and implement changes.
• Familiarity with tools like Git, CI/CD pipelines, and basic DevOps practices (GitOps experience is a plus).
• Understanding of API structures and integration concepts.
• Detail-oriented mindset with a passion for system stability and continuous improvement.

Nice to Have:

• Experience with cloud platforms (e.g., AWS, Azure, GCP).
• Exposure to monitoring tools (e.g., Datadog, CloudWatch).
• Familiarity with data visualisation or reporting tools.
• Previous experience working in cross-functional teams and agile environments.

What We’re Looking For:

• Someone who takes pride in keeping systems running smoothly and efficiently.
• A practical problem-solver who enjoys getting into the details and fixing root causes.
• A communicator who can bridge the gap between technical teams and business users.
• A collaborative team player who can work independently and proactively.