Data Platform Data Engineer - AVP - SMBC

About the company

SMBC: A trusted partner for the long term

Here at SMBC Group, we want to help you find the next step in your career so read on to discover if this opportunity is the one for you. We like to recognise potential in our people, so we welcome your application even when your experience doesn't perfectly align with the job description. Whilst we'll always strive to be better, we're proud of our inclusive culture, and encourage our applicants and colleagues to be their authentic, unique selves.

United by a sense of purpose towards our customers - to be a trusted partner for the long-term - and our universal banking platform in EMEA, SMBC Group has an international growth agenda and award-winning products, meaning we provide exciting opportunities to work on a diverse range of projects and initiatives. We deliver a full suite of corporate finance products and solutions to our customers as well as investment banking and advisory services, and a range of innovative solutions in global capital markets. Read on to find out how you could enhance your skills and gain valuable experience, by joining us to support our clients transition to a sustainable future.

Background The newly created EMEA Data & Analytics Technology team has been put in place to deliver data integration, reporting, and analytics services to the SMBC EMEA business. It exists within the wider ITSD department that is responsible for all IT delivery to the SMBC EMEA enterprise.

Your tasks

Purpose of Job We are seeking an experienced and skilled Data Platform Data Engineer to join the Data Platform Delivery Team in EMEA Data & Analytics Technology. The successful candidate will play a key role in designing, implementing, and maintaining robust data infrastructure and pipelines to support our organization's data-driven initiatives, ensuring optimal performance, scalability, flexibility, and reliability. The data platform is to be built in a hybrid cloud environment with Azure and some components residing in our on-prem data centre. The platform is to be built on a green field basis and legacy capability migrated to it. The role will include the following.

• Understanding of business and data requirements and translation to data pipeline and systems design.
• Implementation of agreed designs.
• Mentoring and guiding other members of the team through collaboration and peer review.
• Building production quality components.
• Aligning the implementation of the Data Platform to the agreed strategy of the platform.
• Deliver excellence in data ingestion and distribution for SMBC EMEA.

The team deliver data and analytics solutions to FO P&L business lines, cross business line departments (eg Finance, Risk, Operations, etc), and the Data Office as a key client. This is within a complex systems environment which has been built over several years and is looking to be re-architected for the next phase of SMBC EMEA growth.

Accountabilities and Responsibilities

• Design and implement scalable and efficient data pipelines, ETL processes, and data integration solutions to collect, process, and store large volumes of data.
• Develop data models, schema designs, and data architecture frameworks to support diverse analytical and reporting needs.
• Build and optimize data processing workflows using distributed computing frameworks available on Azure, our preferred cloud provider.
• Implement data transformation logic to cleanse, validate, and enrich raw data for analysis and consumption by downstream applications.
• Integrate data from various internal and external sources including databases, APIs, and streaming platforms into centralized data repositories and data warehouses.
• Ensure data quality and consistency by implementing validation checks, data profiling, and error handling mechanisms.
• Optimize data pipelines and processing algorithms for performance, reliability, and scalability to handle growing data volumes and user demands.
• Identify and resolve performance bottlenecks, optimize SQL queries, and fine-tune system configurations for improved efficiency.
• Implement data governance policies, access controls, and encryption mechanisms to ensure the confidentiality, integrity, and availability of sensitive data.
• Collaborate with security and compliance teams to adhere to regulatory requirements and industry best practices.
• Monitor data pipelines, job schedules, and system health metrics to proactively identify issues and ensure the availability of data infrastructure.
• Perform routine maintenance tasks, data backups, and disaster recovery procedures to mitigate risks and ensure data continuity.
• Create and maintain technical documentation including system architectures, data flow diagrams, and operational procedures.
• Share knowledge and best practices with team members through code reviews, technical presentations, and training sessions.

Requirements

Essential

• Extensive experience working as an analyst developer or data engineer in a data-centric environment.
• Proven experience in designing and implementing end-to-end data solutions from ingestion to consumption.
• Strong experience with Azure data PaaS services and data pipeline delivery on the Azure platform with Databricks.
• Experience delivering data platforms with C#, Python, JSON, XML, APIs, and message bus technology. Or similar technologies.
• Strong knowledge of database systems, data modelling, and data integration technologies.
• Strong Analytical and problem-solving skills with the ability to troubleshoot complex issues and propose effective solutions.
• Ability to analyse data requirements, identify patterns, and design scalable data designs to meet business needs.Strong experience of different data architectures including hub and spoke, data lakes, data fabr

What we offer

The anticipated salary range for this role is £70,000 - £106,000, with the final offer determined based on the candidate's skills, experience, role scope, location, and relevant market factors. In addition to base salary, the role may be eligible for a discretionary incentive award and a competitive benefits package, including core benefits such as pension provision.

Other

Facts and Scale

• Will be working in a team of circa 100 IT staff across multiple locations within a department of 500+
• Will deliver robust, reliable, performant, and maintainable components of the Data Platform for use across the SMBC EMEA entity covering capital markets and corporate banking activities.
• Will attend the London office at least 2 days a week.