Data Platform Engineer
Riachtanach:PythonGitAWSKubernetesDevOpsDataAgile
Role Overview
We are looking for an experienced Data Platform Engineer to support the development and operations of Data Warehouse . The role will focus on building and maintaining scalable data pipelines, ETL/ELT workflows, data platforms, and analytics engineering solutions, while providing ongoing production and application support.
Key Responsibilities
- Develop and maintain data pipelines, ETL/ELT processes, and analytics engineering workflows to support advanced data search and retrieval.
- Collaborate with data and engineering teams to understand requirements and automate deployment, monitoring, and operational processes .
- Optimise data storage, processing, and query performance while troubleshooting technical issues.
- Coordinate with data engineers and stakeholders to support sprint planning and timely delivery .
- Perform BAU monitoring, investigation, troubleshooting, and incident resolution .
- Support data governance and data management initiatives.
- Provide day-to-day production and application support , ensuring platform stability and reliability.
- Develop and maintain unit and integration tests to ensure data and application quality.
Requirements
- Degree in Computer Science, Information Technology , or a related discipline.
- At least 5 years of hands-on Software Engineering or Data Engineering experience .
- Strong programming experience in Python and ETL
- Strong experience with unit and integration testing .
- Experience with AWS and Kubernetes (K8s) .
- Familiarity with modern data platforms and technologies such as Snowflake, Databricks, Apache Spark, Apache Hive, Delta Lake, Apache Iceberg, and vector databases .
- Experience with workflow/orchestration technologies such as Apache Airflow, Dagster, Prefect, or Temporal .
- Familiarity with GitHub workflows, Datadog, DevOps practices, and Agile methodologies .
- Good analytical, troubleshooting, communication, and collaboration skills.
Key Technologies
Python | AWS | Kubernetes | Snowflake | Databricks | Apache Spark | Apache Hive | Delta Lake | Apache Iceberg | Vector Databases | Airflow | Dagster | Prefect | Temporal | GitHub | Datadog | ETL/ELT