IT Data Engineer

Tanggung Jawab

• Membangun pipeline modular dengan scheduling, error handling, retry logic
• Mendesain data model (star/snowflake) untuk warehouse
• Data profiling & monitoring pipeline
• Deploy pipeline ke production & menjelaskan kualitas data ke stakeholder

Kualifikasi

• Menguasai SQL & Python (atau Scala) untuk data processing
• Pemahaman dasar ETL/ELT & data warehousing
• Mampu mendokumentasikan data flow
• Teliti pada kualitas data

Nilai Tambah

• Pipeline modular (scheduling, error handling, retry)
• Desain data model (star/snowflake) & data warehousing
• Orchestration tool (Airflow, Prefect, Dagster)
• Spark/Flink & distributed processing
• dbt & data lakehouse (Delta Lake, Iceberg)
• Streaming (Kafka, Pulsar, Kinesis)
• Data quality tools (Great Expectations, Soda) & compliance (PDPA, GDPR)

Skills: Apache Spark, Data Warehouse, Python, ETL, SQL, Apache Airflow