Lead Data engineer GCP (M/F)
Company Description
Meritis is an IT consulting, management, and development firm founded in 2007, present in Paris, Sophia-Antipolis, Aix-en-Provence, Montpellier, Toulouse, Nantes... and soon in new territories! Our mission? To connect the best talents with companies to give them a head start.
We support our clients in all their digital transformation needs across numerous areas of expertise: Software Engineering, Finance, Project Management, Devops, Data, Cloud, Cybersecurity, or even Agility.
Operating in sectors ranging from Banking, Insurance, and Telecommunications to Industry and Transport, today 40% of CAC40 companies are Meritis clients.
Driven by our values of excellence, humility, kindness, and proximity, we now have more than 900 employees.
We make it a point of honor to stay close to our employees and support them individually, regardless of their role within the company. Certified Great Place To Work since 2013, our conception of well-being at work goes far beyond a simple label; it is our employees who speak of it best: https://www.glassdoor.fr/Avis/Meritis-Avis-E1163008.htm.
Job Description
As part of the development of a new data platform dedicated to marketing and customer personalization, we are looking for a Lead Data Engineer (M/F) specializing in real-time streaming architectures on Google Cloud Platform (GCP).
You will join a new team and participate in the construction of a modern, scalable, and high-performance data platform, from the initial design phases to the industrialization of data pipelines.
Your missions:
- Design, develop, and maintain real-time streaming data pipelines on GCP
- Participate in the design and construction of streaming architectures based notably on Apache Beam and Google Cloud Dataflow
- Collect, transform, enrich, and ensure the reliability of large-scale data, particularly flows from Google Tag Manager
- Design processing adapted to real-time constraints: management of time windows, continuous aggregations, watermarks, and late event processing
- Contribute to the implementation of a modern, scalable, and resilient data platform, adapted to the challenges of marketing and customer personalization
- Participate in architectural choices and the initial construction phases of the project
- Guarantee the quality, performance, and reliability of the developed pipelines
- Implement best practices for development, testing, and continuous integration
- Contribute to the industrialization and automation of deployments using CI/CD tools and Infrastructure as Code
Qualifications
- You have an engineering degree / Master's degree in data
- You have 5 years of experience in Data Engineering in a GCP cloud environment
- You specifically master:
- Development: Java and/or Python.
- Real-time streaming: Apache Beam, Google Cloud Dataflow, Apache Spark Streaming, or Apache Flink.
- Streaming concepts: Event Time vs Processing Time, Windowing, Continuous Aggregation, Watermarks, and late event management.
- GCP Environment: BigQuery, Dataflow, Dataproc, and associated services.
- Industrialization: CI/CD, GitHub Actions, Terraform, and Git.
- Data Engineering: large-scale data processing, data quality, performance optimization, and pipeline reliability.
- Mastery of English (written and oral) is mandatory
- You are proactive and autonomous, with strong leadership
Additional Information
- Tailor-made professional paths (career evolution, adapted training, mentoring...);
- The choice of your mission and personalized support throughout your career;
- Evolving in an environment where learning is encouraged: certifying training, e-learning, meetUp, coding competitions, evolution paths, etc.;
- Being part of expert communities that share their knowledge and experience within our competency centers;
- A friendly environment with many festive events (annual party, seminars & teambuilding, lunches and afterworks...);
"Meritis is committed to Corporate Social Responsibility. We value our positive impact on society and the environment. Our CSR approach guides each of our actions to promote equity, sustainability, and the well-being of our employees. Join us to be part of this responsible approach, where each of our talents contributes to building a better future.
Our differences are our assets. That is why Meritis is committed to diversity and non-discrimination. All our professions are accessible to people with disabilities."