Senior DataOps Engineer

Join the team responsible for the development and maintenance of a scalable data infrastructure platform that processes billions of events every day. We are looking for a Senior Data Engineer who not only builds pipelines but, above all, can independently operate production data infrastructure, from reliability and observability, through performance tuning, to upgrades and platform development.

Daily tasks

• maintenance and development of pipelines ingesting billions of events daily within a defined SLA,
• development of tools and frameworks for the data platform,
• support for teams building and optimizing complex data pipelines,
• identifying and resolving platform issues together with other engineering teams,
• supporting Data Scientists and Data Analysts with production workloads,
• participation in initiatives related to ML Platform and streaming,
• development of good software engineering and data development practices.

Requirements

4+ years of experience in Data Engineering in a similar position, very good knowledge of Spark + Scala + Python, experience in building and maintaining complex ETL pipelines, experience with large datasets, practical knowledge of cloud solutions, experience with orchestration tools, e.g., Airflow, practical experience with Kubernetes and GKE (Google Kubernetes Engine), experience in maintaining and operating production data infrastructure on GKE, experience with CI/CD, e.g., Jenkins + Git, very good understanding of Software Engineering practices and principles, independence, ownership, and very good communication skills, advanced knowledge of English.

Must have: Python, ETL, Kubernetes