Hadoop Data Engineer at DeARX Services (Pty) Ltd

What Youll Do:

• Data Pipeline Development: Create and maintain scalable data pipelines using Ab Initio and develop efficient ETL processes.
• Data Integration & Management: Integrate data from diverse sources to ensure a unified and high-quality data environment.
• Performance Optimization: Monitor, optimize, and implement best practices for data pipelines and ETL processes.
• Collaboration: Work closely with data scientists, analysts, and stakeholders to address data needs and ensure seamless integration.
• Troubleshooting & Support: Resolve data issues and provide support for data-related queries.

What Were Looking For:

• Education: Bachelors or Masters degree in Computer Science, Engineering, IT, or a related field.

Experience:

• 5+ years in data engineering and ETL development.
• Extensive experience with Ab Initio, SQL, and big data technologies (Hadoop, Spark, Hive).

️ Skills:

• Strong analytical and problem-solving skills.
• Excellent communication and teamwork abilities.
• Knowledge of data modeling, warehousing, and integration best practices.

Bonus Points:

• Experience with cloud platforms like Azure.
• Familiarity with Python or R scripting.
• Understanding of data governance and security practices.