Data Engineer at Hire Resolve

Responsibilities

• Automate repetitive data workflows to improve processing efficiency and reduce manual tasks.
• Collaborate with data scientists, machine learning engineers, and other stakeholders to understand data requirements and deliver effective solutions.
• Build and optimize ETL (Extract, Transform, Load) processes for accurate and streamlined data collection, transformation, and storage.
• Maintain thorough documentation of data processes, systems, and workflows for transparency and future reference.
• Integrate data from various sources, including APIs, databases, and external platforms, ensuring seamless data flow.
• Manage and enhance database systems with a focus on data integrity, performance, and security.
• Design, implement, and maintain scalable data pipelines and infrastructure for efficient data flow and management.

Requirements

Technical Skills:

• Proficiency in SQL and experience with relational databases (e.g., MySQL, PostgreSQL).
• Knowledge of big data tools and technologies (e.g., Hadoop, Spark).
• Experience with data pipeline and workflow management tools.
• Proficiency in programming languages such as Python.
• Experience with cloud services (e.g., AWS, GCP, Azure) and data warehousing solutions (e.g., Redshift, BigQuery).
• Familiarity with data modeling, data warehousing, and ETL processes.
• Experience: Proven experience as a Data Engineer, Data Architect, or in a similar role.
• Education: Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.