Senior Python Backend Engineer – Data / GCP
We're looking for Senior Python Developer to join our client's project
Daily tasks
- Design, implement and maintain Apache Airflow DAGs
- Manage and optimize Google Cloud Composer environments
- Develop Python backend services and REST APIs
- Use Pydantic for schema modelling, validation and type enforcement
- Build integrations between pipelines and backend services through APIs
- Handle authentication, retries, idempotency and standardized response models
- Develop reusable Airflow operators, hooks and utilities
- Work with BigQuery, GCS, Pub/Sub, IAM and Cloud Functions
- Implement logging, monitoring, alerting and testing
- Troubleshoot production issues and perform root-cause analysis
- Collaborate with Data Engineering, Platform and Product teams
Requirements
Strong senior-level Python backend development experience Hands-on Apache Airflow + Google Cloud Composer experience Strong GCP / data platform experience Hands-on Pydantic experience Strong REST API development/integration experience Airflow: DAGs, operators, sensors, hooks and XComs GCP: BigQuery, GCS, Pub/Sub, IAM and Cloud Functions OAuth2, JWT and API-key authentication Nice to have GraphQL Development of reusable Airflow components/frameworks Strong production troubleshooting and observability experience
Must have: Python, Apache Airflow, Cloud Composer, GCP, REST API, BigQuery, PUB, IAM, Cloud, OAtuh 2, JWT, API-key authentication
Nice to have: GraphQL, Airflow, Troubleshooting