Data Engineer

Job Details:

Role: Data Engineer

Employment Type: 1 year & extendable contract

Work Location: Abu Dhabi, United Arab Emirates

Notice Period: Immediate joiners to a max of 15-30 days of notice

Responsibilities:

• Data Engineering and pipeline implementations: Curate structured, semi-structured, and unstructured data by creating efficient, cost effective and scalable pipelines leveraging databricks and Azure Analytics stack
• Pipeline Development: Create and maintain robust data pipeline architecture, ensuring data quality, reliability, and scalability.
• Data Management: Assemble and manage large, complex data sets to meet functional and non-functional business requirements.
• Process Improvement: Identify, design, and implement process improvements, including automation of manual processes and optimization of data delivery.
• Alignment: Align with Data Engineering chapter standards and processes.

Education & Experience:

• 3-10 years in a Data Engineer role, with a degree in Computer Science, Statistics, Informatics, Information Systems, or a related field.
• Technical Skills: Experience with Databricks and Microsoft Azure analytics stack. Advanced proficiency in SQL and familiarity with various databases.
• Data Modelling: Understanding of data modelling techniques for analytics.
• Root Cause Analysis: Ability to perform root cause analysis on internal and external data and  processes to answer specific business questions and identify opportuniTIes for improvement.
• DataSecOps: Experience with data security operations, preferably on the Azure stack.
• Data Management Frameworks: Awareness of data management frameworks (e.g., DAMA) and exposure to data quality and catalogue tools such as Collibra or Alation.