Data Engineer at Kuda

Role Overview

• We are looking for an experienced Data Engineer to join our team. You will use various methods to transform raw data into useful data pipelines and information systems. For example, you will create algorithms and conduct statistical analysis. Overall, you will strive for efficiency by aligning data systems with business goals.
• To succeed in this data engineering position, you should have strong analytical skills and expertise in combining structured, semi-structured, and unstructured data from various business sources. Data engineer skills also include familiarity with several programming languages and knowledge of machine-learning algorithms.
• We would like to hear from you if you are detail-oriented, with excellent organizational skills, and have a passion for integrating disparate data pipelines into a modern, meaningful information pipeline.

Responsibilities

• Analyze and organize raw data.
• Build, maintain, and test data ingestion and processing pipelines.
• Integrate raw data from various diverse sources.
• Interpret trends and patterns.
• Prepare data for prescriptive and predictive modeling.
• Explore ways to enhance data quality and reliability.
• Manage data and meta-data.
• Track data pipeline stability
• Develop analytical models for visualization and advanced analytical tools and programs.
• Collaborate with the data engineering team, data scientists, business stakeholders, and architects on projects.

Requirements

• 3+ years of experience as a Data Engineer or in a similar role
• 3+ years of experience using SQL
• Proven experience with Microsoft SQL Server/ Azure SQL DB
• Knowledge and ability to integrate, transform, and consolidate data from MS Azure SQL Database/ SQL Managed Instances/ Google Big Query into structures that are suitable for building modern analytics solutions in GCP with Big Query and visualized in Looker
• Exposure to SQL Server Integration Services (SSIS) or dbt Cloud
• The ability to design, implement, monitor, and optimize data platforms to meet the data pipeline needs
• Candidates with Azure Data Factory (ADF) knowledge is an added advantage
• Knowledge of programming languages (e.g., Python, Java, and C/C#), is an added benefit.
• Experience using modern software engineering practices (Agile)
• Knowledge in using computational and mathematical thinking processing when engineering solutions
• Degree in Computer Science, Engineering, similar field, or relevant real-world experience
• Data engineering certification (e.g., Azure/AWS/Google/IBM Certified Data Engineer) is a plus

Data Stack:

• Azure Microsoft SQL Server
• Fivetran
• Google Big Query
• Google Cloud Platform
• Dbt Cloud
• Looker