Data Engineer - 6 months contract
Must-have:PythonGitDataQA/Test
About the Role Join our client analytics team to turn data into clear, actionable insight. You will query, clean and transform datasets on the Databricks platform, build dashboards that help stakeholders monitor performance and understand user behaviour, and document your work so others can use it with confidence.You will also have the opportunity to grow your project management skills through hands-on work with user stories, JIRA and QA testing. What You Will Do 1.Data Transformation
- Query, clean, and transform datasets using SQL and Python on the Databricks platform.
- Ensure data quality and consistency across systems in accordance with government Instruction Manual (IM8) standards.
- Analytics & Dashboard Development
- Build, enhance, and maintain dashboards for data monitoring, performance reporting, and user behaviour analytics.
- Partner with business stakeholders to understand data requirements and translate them into impactful visual insights.
- Documentation & Knowledge Management
- Develop clear and comprehensive user guides for dashboards, charts, and data workflows in Databricks.
- Maintain technical documentation (e.g., on Confluence) for analytics processes, standards, and best practices.
- Additional Opportunities
- Explore and prototype automation solutions to streamline repetitive or manual workflows.
- Develop project management competencies, including:
– Creating user stories and acceptance criteria – Managing JIRA tickets and sprint tasks – Writing and executing QA test cases What We Are Looking For
- Required Skills
- Proficiency in SQL and Python for data processing and automation.
- Hands-on experience in dashboard tools such as Tableau, Power BI, or equivalent visualisation tools.
- Familiarity with Databricks or similar big data/analytics platforms.
- Ability to produce high-quality technical documentation.
- Preferred Skills
- Experience in system testing, SIT/UAT, or quality assurance processes.
- Knowledge of Spark for distributed data processing.
- Understanding of Git or other version control systems.
- Soft Skills
- Strong analytical mindset and problem-solving abilities.
- Good communication skills, especially in explaining technical concepts to non-technical users.
- Ability to work independently as well as collaboratively in cross-functional teams.
- Attention to detail and commitment to delivering high-quality work.