Senior Data Engineer at Black Swan Data

You will be working closely with the Exeter, the UK based Engineering team and the Szeged-based Data Science team to deliver on the release road map. Will closely collaborate with the Data Science team in Szeged to ensure all team outputs follow coding best practice. Takes a consultative approach to anticipate stakeholder needs, and ensure delivery of high-quality production-ready Data Science code for use within Black Swans Platform.

Key Accountabilities include:

• Responsible for working with Data Science to improve Black Swans platform to better incorporate complex Data Science models
• Responsible for working with Engineering to improve Data Science build efficiency while maintaining high quality of output
• Provide technical leadership to other Data Engineers
• Work with other Data Engineers to expand the teams’ knowledge.

Personal Attributes: 

• Bachelor's degree in Computer Science or equivalent 
• An organised problem solver, able to prioritise efficiently and comfortable processing large amounts of information
• Excellent listening and communication skills (written and verbal), including the ability to express thinking coherently
• Strong proficiency in the English language
• Professional attitude and commercially aware. Able to use their own initiative and apply critical thinking to business challenges
• Strong team-working and interpersonal skills, including ability to respond to stakeholder requests in a timely, professional and considerate manner
• A passion for developing new solutions and challenging the status quo, with an interest in new emerging technologies and the potential in data

Desired Skills and Experience:

• Proven commercial experience as a Software Developer - working on the development of back-end solutions with AWS, especially on data-driven systems.
• Expert knowledge of Core Java
• Experience with running Data Science models in a distributed processing architecture
• Experience with ETL across large data sets
• Understanding of how to process large amounts of data considering memory usage across the JVM
• Knowledge of AWS infrastructure
• Understanding of distributed processing
• Experience with Agile methodologies
• Experience in GIT
• Experience mentoring junior developers.

The following skills are ideal but not essential:

• Experience with Spark or Hadoop
• Experience with IDEs such as IntelliJ, Eclipse or similar
• Experience with Scala
• Experience with Python
• Experience with Databricks platform
• Experience with data annotation and labelling work for supervised machine learning
• Understands how to build robust social media data queries using appropriate and efficient syntax
• Strong SQL skills