Mid / Senior Data Engineer (Python | Confluent Cloud | Kafka)

Your tasks

• Designing, implementing, and maintaining streaming Data Pipelines based on Apache Kafka and Confluent Cloud.
• Integrating distributed systems and data sources using an Event-driven Architecture approach.
• Creating and optimizing code in Python and complex SQL queries/scripts.
• Configuring and managing database Change Data Capture processes (CDC Tools).
• Collaborating on the integration of cloud solutions (GCP) and non-relational databases (MongoDB).
• Ensuring high performance, reliability, and scalability of the data flow architecture.

Requirements

• Confluent Cloud (key – certification is welcome, but not a requirement)
• Kafka (practical knowledge and commercial experience)
• Very good knowledge of Python
• Very good knowledge of SQL
• English at a level of fluent communication in speaking and writing (B2+)

• Knowledge of Event-driven Architecture patterns
• Experience with CDC (Change Data Capture) tools
• Knowledge of GCP (Google Cloud Platform)
• Experience working with MongoDB

Must have: Python, Cloud, Kafka, SQL

Nice to have: GCP, Google Cloud Platform, MongoDB

What we offer

Rate (determined individually):140 - 155 PLN net + VAT / h*

Other

We are looking for an experienced Data Engineer to strengthen our team in the area of real-time data processing and event-driven architecture. · Engagement terms · Area: IT Consulting · Location: 100% remote *Travel: none Start:** ASAP (we accept candidates with a max 1-month availability to start)

Engagement: B2B (outsourcing via 1dea), full-time, long-term (6m + extension)