Senior / Lead Data Engineer Cloud (Terraform, DBT, Azure)

Job Title: Senior / Lead Data Engineer Cloud (Terraform, DBT, Azure)

Key Skills: DBT, Azure Databricks, Terraform, SQL, Python, Delta Lake, Unity Catalog, AI-Assisted Development, Data Engineering, CI/CD

Experience: 5+ years of experience.

Location: Open to candidates across LATAM.

At Coforge, we are looking for a Senior / Lead Data Engineer Cloud (Terraform, DBT, Azure) (#22555) with the following profile.

Responsibilities

• Design, build, and maintain scalable DBT models on Azure Databricks, delivering curated and governed gold-layer data domains in a production environment.
• Develop and optimize data solutions using Delta Lake, Unity Catalog, and Medallion Architecture principles.
• Leverage AI-assisted development tools, including Claude Code and similar platforms, for model generation, refactoring, debugging, testing, and documentation.
• Build and maintain comprehensive data quality frameworks through DBT tests, validation rules, automated testing, and monitoring practices.
• Participate in rapid development and deployment cycles through pull-request-based workflows, AI-supported code reviews, and CI/CD quality gates.
• Collaborate with platform and engineering teams to define and implement AI-driven development practices and reusable engineering patterns.
• Curate datasets, semantic definitions, business terminology, and analytical assets to support natural-language data consumption and self-service analytics initiatives.
• Contribute to the evolution of data engineering best practices, including AI-assisted DBT development, data contracts, observability, and domain-driven ownership models.
• Support modernization initiatives through automation, migration acceleration, and AI-powered engineering workflows.
• Drive adoption of engineering standards, documentation practices, and scalable delivery methodologies.
• Measure and improve the effectiveness of AI-generated code, automated test coverage, and engineering productivity metrics.
• Work directly with business stakeholders to ensure delivered data products align with business objectives and quality expectations.

Mandatory Requirements

• 5+ years of experience in Data Engineering.
• At least 2 years of hands-on experience building, deploying, and supporting production-grade DBT projects.
• Strong expertise in DBT, including models, tests, macros, snapshots, project structure, and large-scale refactoring.
• Advanced SQL skills and solid Python programming experience.
• Hands-on experience with Azure Databricks, including Delta Lake, Unity Catalog, and Medallion Architecture.
• Strong understanding of data modeling, data transformation, and cloud-based analytics platforms.
• Experience implementing and managing Infrastructure as Code (IaC) solutions using Terraform.
• Strong testing mindset, including DBT testing frameworks, data quality validation, and automated quality controls.
• Experience with tools such as dbt-expectations, Great Expectations, or similar testing frameworks.
• Experience working with Git-based development workflows, pull requests, code reviews, and CI/CD pipelines.
• Familiarity with modern AI coding tools such as Claude Code, GitHub Copilot, Cursor, or similar technologies.
• Ability to independently own and deliver data domains from design through production deployment.
• Strong communication and stakeholder engagement skills.

Preferred Requirements

• Experience curating Databricks Genie environments or building semantic layers for natural-language analytics.
• Experience within insurance, financial services, or other regulated industries.
• Knowledge of policy, claims, customer, exposure, or regulatory reporting data domains.
• Experience with PySpark for large-scale transformation workloads.
• Experience with orchestration technologies such as Databricks Workflows or Apache Airflow.
• DBT, Databricks, Azure, or cloud-related certifications.
• Experience with Data Observability, Data Contracts, and Domain Ownership frameworks.
• Exposure to Databricks DLT (Delta Live Tables), Lakeflow, Asset Bundles, and advanced Databricks capabilities.
• Experience implementing AI-assisted migration, modernization, or engineering transformation initiatives.
• Familiarity with engineering productivity metrics and AI adoption measurement frameworks.

Published on: 31-08-2026

At Coforge, we hire professionals solely based on their skills and qualifications and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.