Data Engineer – Junior

Mandatory

• 2–4 years of data engineering or backend development experience
• Familiarity with Agile delivery
• Working knowledge of SQL and Java or Scala
• Basic experience developing batch or streaming pipelines using Apache Spark, Apache Flink or Apache Kafka
• Familiarity with containerised deployment, Kubernetes and S3-compatible object storage
• Experience implementing mappings, transformations, validation checks and scheduled workflows, and supporting pipeline monitoring and defect resolution under guidance

Preferred

• Familiarity with the SAFe framework
• Familiarity with Apache Kafka, Apache Spark, Apache Flink or comparable processing technologies, and
• MinIO or equivalent S3-compatible object storage
• Familiarity with relational databases, Git, CI/CD, Docker and automated testing

Equivalent Technologies

• Apache Spark or equivalent data-processing frameworks; Apache Airflow or equivalent workflow orchestration tools; other S3-compatible object-storage platform