Data Engineer

Job details

Position title: Data engineer

Reports to: Data and AI manager

Business line / department: Data and automation / IT

Job purpose

The job holder is responsible for building and maintaining data pipelines, ETL/ELT processes, and data integration solutions that move and transform data across the data platform to support analytics, reporting, and AI applications.

Job deliverables - accountability

Pipeline success rate ? 99%

Data freshness SLA meets agreed refresh schedule

Data quality score ? 95%

Pipeline documentation 100%

Incident response ? 2 hours for pipeline failures

Know how (applying of knowledge & skills in job tasks)

Data pipeline development

Design, build, and maintain ETL/ELT pipelines using Azure Data Factory, Synapse, or Databricks.

Integrate data from D365 ERP, POS, e-commerce, and external sources into the data warehouse.

Monitor pipeline performance and resolve data failures promptly.

Requirements

Data quality

Implement data quality checks and validation within pipelines.

Collaborate with data analysts and BI developers to resolve data issues.

Maintain data lineage and documentation for all pipelines.

Note: The principal accountabilities listed above are an illustrative list and not an exhaustive list. Additional responsibilities may be added from time to time depending on organizational requirements.

Qualifications, experience

Minimum qualification

• Bachelor degree in Computer Science, Data Engineering, or IT.

• Certified in Azure Data Engineer Associate preferred

Minimum experience

• Minimum experience of 3–5 years in data engineering.

Other requirements (skills set)

• Azure Data Factory, Synapse Analytics, Databricks

• SQL, Python, Spark for data transformation

• D365 data integration: OData, Data Integrator, dual write

• Data quality and testing in pipelines

• Git and Azure DevOps for pipeline code management

Languages: Arabic (professional) · English (professional)