Data Engineer GCP - Freelance (M/F)

Daily Rate (TJM): 460

Need Description:

DESCRIPTION OF NEED: Client: BPCE SA Position: Data engineer GCP - Datops Project Experience: 3 to 6 years Start Date: 28/09 Location: Charenton-Le-Pont

Context

Within the IT department of BPCE SA (DSI Corporate), the DSI T&O and BPA aims to provide the Technologies & Operations services (Global Business Management and Transformation (GBMT), WorkPlace, CIO Office Groupe hubs) and Banque de Proximité et Assurance (BPA) with all the applications necessary for their operation.

Missions

We are looking for a GCP data engineer profile who will be responsible, in connection with the application production / devops team, for the technical implementation of business requests on the DatOps project. Passionate about development and data processing, capable of adapting to a dynamic and constantly evolving environment, the service provider must demonstrate autonomy, initiative, and a strong analytical capacity to solve complex problems.

The following tasks will be assigned to the consultant:

• Implement new data ingestions, data prep/transformation
• Maintain and evolve our data pipeline management tools
• Address requests related to platform evolutions to the devops team

Business Skills

• Develops and builds data infrastructures from a system and security perspective.
• Ensures the collection, storage, and exploitation of data flows meeting the company's challenges.
• Guarantees qualitative access to data sources that feed storage spaces to facilitate exploitation by Data Scientists and Data Analysts.
• Also defines the metadata structure.
• Industrializes Machine Learning models.
• Maintains and participates in the RUN monitoring of developed applications/models.
• Maps and documents data sources.
• Ensures the maintenance of various applications deployed in production and associated infrastructures.
• Designs solutions allowing the processing of large volumes of data flows.
• Structures databases (semantics, format, etc.).
• Contributes to the management of data repositories.
• Captures and stores data (structured or unstructured) produced in various applications or coming from outside the company.
• Ensures the supervision and integration of data of various natures coming from multiple sources. Verifies data quality and ensures its security.
• Assists Data Scientists in optimizing the technical performance of Machine Learning models.
• Industrializes Machine Learning models designed by Data Scientists.
• Stays alert regarding technologies related to data processing and manipulation and identifies usable solutions.
• Proposes evolutions for the data Infrastructures and solutions in place.

The ideal consultant should possess the following skills:

• Excellent mastery of the GCP platform, and other tools in our technical stack: BigQuery, cloud storage, SQL, object-oriented Python, Pandas and/or Dask, bash scripting, GIT
• Knowledge and experience with the following complementary tools would be appreciated assets: Cloud functions, SAS, Alteryx, XLD/XLR, ControlM, Hadoop, Spark
• Mastery of English, both written and spoken, to facilitate exchanges with our interlocutors based in Porto, who represent a significant part of our IT team.
• Experience in agile environments, particularly with the SCRUM methodology.
• Ability to write clear and precise technical specifications.
• Dynamism, excellent interpersonal skills, and ability to work in a team.
• Proactive and technical curiosity to explore new solutions and technologies.