Senior Data Engineer

ABOUT THE ROLE

We are looking for a Senior Data Engineer with strong Microsoft Fabric expertise to join a fast-growing data engineering team. You will be responsible for designing, building, and optimizing data solutions on the Microsoft Fabric platform — working across the full data engineering lifecycle from ingestion to serving. The ideal candidate brings deep hands-on experience with Fabric, a strong engineering mindset, and the ability to work independently in a collaborative, delivery-focused environment.

WHAT YOU WILL DO

• Design and build end-to-end data pipelines using Microsoft Fabric Data Factory
• Develop and maintain Fabric Spark Notebooks for data transformation and processing
• Migrate legacy data pipelines and workloads onto the Microsoft Fabric platform
• Implement and manage data warehouse solutions using Fabric Warehouse and OneLake
• Build and maintain Medallion architecture (Bronze / Silver / Gold) on OneLake
• Design and implement SCD Type 1/2 patterns and complex transformation logic in PySpark and T-SQL
• Develop and maintain CI/CD workflows using Fabric Deployment Pipelines and Azure DevOps
• Collaborate with architects and business stakeholders to translate requirements into scalable data solutions
• Ensure data quality through reconciliation, testing, and validation across environments
• Support UAT, parallel run activities, and production cutover cycle

REQUIRED SKILLS

• Microsoft Fabric — Fabric Data Factory, Spark Notebooks, Fabric Warehouse, OneLake, Deployment Pipelines
• Azure Data Factory —pipelines, master/child patterns, Copy / Lookup / ForEach / Stored Procedure activities
• PySpark and Python — Delta Lake read/write, transformation logic, file I/O on OneLake / ADLS
• T-SQL — complex stored procedures, MERGE, SCD logic, dynamic SQL
• Medallion architecture (Bronze / Silver / Gold) implementation on Fabric or Databricks
• Databricks — notebooks, dbutils, workspace files, cluster configuration
• CI/CD with Azure DevOps and Git — branching strategy, PR-gated deployments, environment promotion
• Experience in Analysis, Design, Development, Implementation, Testing and Support of Data Warehousing and Data Integration Solutions and ETL data pipelines
• 5+ years in data engineering with at least 1 year hands-on in Microsoft Fabric

NICE TO HAVE

• Microsoft Fabric certification (DP-700 or equivalent)
• Experience migrating from Databricks or ADF to Microsoft Fabric
• Financial services or investment data domain knowledge
• Microsoft Purview — lineage, sensitivity labels, workspace scanning
• Power BI Direct Lake mode and semantic model design
• Experience in ETL design and development, Data Quality, and Data Engineering using Informatica.