Data Engineer - Iceberg/Snowflake
Must-have:PythonGitAWSCloudDataCI/CDAI
JobResponsibilities
- Design, develop, and implement scalable data engineering solutions to support PIPL program requirements.
- Build and maintain end-to-end ETL/ELT pipelines using Python , SQL , and modern data engineering frameworks.
- Develop and manage data lakehouse architectures using Apache Iceberg and Snowflake .
- Create and support a dedicated China data environment on Alibaba Cloud (AliCloud) for data processing, analytics, machine learning, and reporting workloads.
- Automate data ingestion, transformation, validation, and reporting processes to improve operational efficiency.
- Optimize data pipelines, storage, and query performance to ensure scalability and reliability.
- Collaborate with architects, program leads, and business stakeholders to gather requirements and deliver data solutions.
- Monitor, troubleshoot, and resolve data platform and pipeline issues.
- Contribute to best practices in DataOps, CI/CD, automation
JobRequirements
- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related discipline.
- 5+ years of experience in Data Engineering, Data Warehousing, or Big Data environments.
- Strong hands-on experience with Apache Iceberg .
- Proven experience working with Snowflake for datawarehousing and analytics.
- Advanced proficiency in Python and SQL development.
- Experience designing and building ETL/ELT pipelines and data integration solutions.
- Solid understanding of data lake, lakehouse, and data warehouse architectures.
- Experience working with cloud platforms, preferably Alibaba Cloud (AliCloud) .
- Knowledge of distributed data processing technologies such as Apache Spark , Flink , or similar frameworks.
- Experience with data modeling, performance tuning, and data quality management.
- Familiarity with CI/CD pipelines, Git, and automation tools.
- Strong analytical, problem-solving, and stakeholder management skills.
- Experience in regulatory or data privacy-focused environments(PIPL/GDPR) is an added advantage.
Must-HaveSkills:
- Apache Iceberg, Snowflake, Python, SQL, ETL/ELT Development, Data Engineering, AlibabaCloud (preferred), Data Lakehouse Architecture.
- Good understanding of AWS services, data lakes, IAM, S3,CloudWatch, and monitoring.