Data Engineer (Snowflake & dbt)
Nõutav:PythonGitGoogle CloudKubernetesCloudDataAgileCI/CDSecurity
Daily tasks
- Design, develop, and maintain data pipelines using Snowflake and dbt.
- Build and optimize ETL/ELT processes.
- Develop and orchestrate workflows using Apache Airflow.
- Integrate structured and unstructured data from various sources.
- Implement and maintain AI-powered OCR solutions for document processing and data extraction.
- Ensure data quality, reliability, and performance.
- Collaborate with Data and AI teams to deliver scalable data solutions.
Requirements
- Hands-on experience with Snowflake.
- Practical experience with dbt.
- Knowledge of Apache Airflow.
- Strong SQL skills and experience with ETL/ELT processes.
- Understanding of Unstructured Data Management.
- Experience or knowledge of AI-powered OCR and document data extraction.
- Strong analytical and problem-solving skills.
Nice to Have
- Python programming skills.
- Experience with cloud-based data platforms.
- Exposure to AI/ML integration and document processing solutions.
Must have: Snowflake, dbt, Apache Airflow, SQL, ETL, Data management
Nice to have: Python, AI, ML