Data Migration Engineer - Contract
Must-have:PythonAWSCloudDataAI
About the role
The Data Migration Engineer builds and runs the migration jobs against the conversion specifications. You will take legacy data carrying personal information, move it onto a controlled cloud platform, and prove through reconciliation that nothing was lost or altered on the way.
The role suits an ETL engineer who is comfortable working under regulatory scrutiny and who treats evidence of correctness as part of the deliverable.
Key responsibilities
- Build the extraction, transformation and load jobs against the conversion specifications.
- Build the reconciliation queries and control totals, covering row counts, control totals and referential integrity.
- Execute the migration cycles and resolve the defects they raise.
- Maintain the data lineage record, so every target field can be traced back to its source.
- Contribute to the source-defect register, logging data quality issues found in the legacy systems.
Experience and background
- 3 to 5 years in ETL or data engineering.
- At least 1 of those years on a migration carrying personal data under a government or regulatory regime.
- Has worked on a Government Commercial Cloud platform, or an equivalent controlled cloud environment.
Technical skills
- AWS Glue, PySpark and Python for building the migration jobs.
- SQL at an advanced level across PostgreSQL and legacy platforms, used for extraction and for reconciliation.
Ways of working
You use AI coding tools as part of normal development and review all generated code before committing it. You stay accountable for what ships, which matters most where the data is personal and the checks are formal.