Specialist Data Engineer at ITC Infotech

About the job

• We are urgently looking for a Specialist Data Engineer who is available immediately with the following experience:
•  5+ years experience
•  Relevant B-Degree in Computer Science OR; equivalent level of industry certification in Technical field & essential if minimum requirements of experience & practical application in the following is evident:
•  3-5 years’ experience with designing and building, BI systems and complex data eco systems
•  3 + years’ experience working in Big data environment (advantageous for all, a must for high volume environments) – optimising and building big data pipelines, architectures and data sets with e.g. Java, Scala, Python, Hadoop, Apache Spark and Kafka
•  Cross domain knowledge
•  Architecture
•  Infrastructure
•  Logical & physical design of data structures
•  Testing
•  Web Applications & specifically knowledge of data desing patterns used within web applciations  Service Side
•  Influencing
•  Automation
•  Messaging
•  Solutioning
•  SSL Security including expertise in encryption methods & data transfer across systems
•  CI/CD etc.
•  Experience as an agile practitioner and knowledge or experience of other delivery methodologies e.g. Kanban, RUP etc.
•  Excellent communication, analytical skills and decision making ability in collaborative environments
•  Excellent understanding of specific coding / scripting languages e.g. Java, C#, Python, Perl, JavaScript
•  Solid understanding of Object Oriented Design and ability to properly apply general design patterns and paradigms
•  Experience with test-driven development and domain driven design
•  Solid understanding of messaging protocols and web services like and REST
•  Experience with open-source relational and NoSQL databases
•  Advanced knowledge of SQL e.g. query authoring
•  Knowledge of systems such as Windows, Linux etc
•  Knowledge of application server containers: Tomcat, Jetty, JBoss, NodeJS, IIS, .Net Core etc.
•  Good understanding of frameworks and libraries like, jQuery, TypeScript, HTML, CSS
•  Experience with CI / CD tools (like Jenkins, Bamboo, TFS, ) and Artifact Management (preferably Nexus),
•  Experience with Cloud platforms e.g. AWS & Google Cloud Platform
•  Ability to create and maintain sophisticated CI / CD pipelines
•  Strong understanding of version control and related concepts and techniques, particularly Git
•  Experience with appropriate unit testing framework(s)
•  Excellent debugging and problem-solving skills.
•  Comfortable with stubbing tools like wiremock and/or hoverfly  Experience with scripting languages like Bash and/or Python
•  Familiar with OAuth, Open Connect ID and SAML, preferably with an understanding of AD / LDAP / Kerberos
•  Familiar with Containerisation technologies like Docker & or orchestrators like Kubernetes