Senior Data Engineer [CET time zone]
About the company
Our Client is a global player in the field of operations, risk, and sustainability services and solutions for companies and industries across the world. As they provide both services and technology for their clients, the Senior Data Engineer we are looking for will support the delivery of value across client's operations and technology ecosystem.
In this position, you are hired by FCamara Europe, the European division of one of the largest and fast-growing tech and cognitive services group in Brazil, with +1500 specialists and engineers. From Portugal we deliver services to the EU, UK, US and MENA, bringing together multicultural, diverse and creative teams through projects, managed services, squads, and staff augmentation.
Your tasks
We are looking for a Senior Data Engineer to be the technical reference for our Databricks data platform. You will design and run reliable pipelines, automate delivery through DataOps and CI/CD, and establish the governance that keeps data secure, traceable and ready for AI models used by global clients.
Responsabilidades e atribuiçõesData engineering on Databricks
Design, build and optimise batch and streaming pipelines on Databricks (PySpark, Spark SQL, Delta Lake, Delta Live Tables / Lakeflow).Evolve the Lakehouse architecture (bronze, silver and gold layers) to ingest operational, behavioural and HSE data from multiple clients and formats.Ensure performance and cost efficiency of clusters, jobs and SQL Warehouses.Deliver trusted datasets to data science, AI and product teams.
Implement CI/CD pipelines for data code using Databricks Asset Bundles, Git and Azure DevOps or GitHub Actions.Automate data testing (unit, integration and quality) and promotion across dev, staging and production.Provision infrastructure as code (Terraform) and standardise pipeline templates.Monitor pipelines, define SLAs and alerts, and lead incident reviews.
Governance and data quality
Implement and administer Unity Catalog: catalogs, permissions, lineage and auditing.Define policies for security, access control, data masking and per-client data isolation.Ensure compliance with LGPD, GDPR and the contractual requirements of global clients.Establish metadata standards, data contracts and quality metrics.
Act as a technical reference, reviewing code and mentoring mid-level and junior engineers.Partner with product, data science and consultants to turn business needs into data solutions.Document architecture, standards and best practices.
Requirements
Requisitos e qualificações6+ years in data engineering, including 3+ years with Databricks in production. Strong Python, PySpark and advanced SQL. Solid experience with Delta Lake and Lakehouse (medallion) architecture. Practical DataOps experience: automated testing, observability and pipeline versioning. Data governance experience, ideally with Unity Catalog (access, lineage, auditing).
Hands-on CI/CD for data (Git, Azure DevOps or GitHub Actions, Databricks Asset Bundles or similar). Cloud experience, ideally Azure (ADLS, Data Factory, Key Vault, Entra ID). Experience with agentic coding Infrastructure as code with Terraform. Fluent English to work with global teams and clients. Degree in Computer Science, Engineering, Information Systems or a related field.
Databricks (Data Engineer Professional) or Azure (DP-203 / DP-700) certifications. Experience with multi-tenant SaaS platforms and per-client data isolation. MLOps knowledge (MLflow, Feature Store, Model Serving) and data pipelines for generative AI / RAG. Microsoft purview experience Data quality tools (Great Expectations, Lakehouse Monitoring, dbt). Streaming with Kafka, Event Hubs or Structured Streaming. Experience with HSE, industrial operations or risk management data.
Other
This is a remote position, and we will consider candidates from Portugal and a limited set of EU countries.
Informações adicionaisThis is a fully remote position. You may occasionally be invited or requested to visit Client or FCamara sites in Portugal or Central Europe on an occasional, pre-planned basis. Regular office visits are not anticipated.
Accepted Countries: Please note that due to contractual and compliance requirements, this role is currently limited to individuals currently and lawfully residing with a work permit in the following countries: Portugal, Bulgaria, Croatia, Estonia, Hungary, Latvia, Lithuania, Slovakia, and Romania.
Nationality and Visa Sponsorship: We welcome you, regardless of your nationality, provided you meet the role requirements and are legally resident in one of the accepted countries. Please note that we do not provide visa sponsorship or relocation support for this role.
This role requires English at a minimum B2+ level (professional working proficiency): Please note that English is the primary language used in the project, and a minimum B2 level is required. If English is not your primary language, we may ask you to complete a fluency assessment.
Long-term project: This position is part of a long-term project.
Contract Model: The role may be offered under one of the following arrangements, depending on your location, interests and professional profile: employment contract, independent contractor, or B2B.