Cloudera Solution Architect (AWS) [M/F]

The project is being carried out for an international financial institution and focuses on the development of a modern data platform based on Cloudera CDP in an AWS environment. The goal of the project is to design and develop scalable Data Lake and Operational Data Store solutions, supporting the processing of large data volumes as well as analytical and business processes. The team works in an Agile environment, utilizing modern Big Data technologies and cloud solutions to build a secure and efficient data architecture.

Daily tasks

• designing comprehensive Data Lake and Operational Data Store (ODS) solutions based on Cloudera on AWS,
• creating solution architecture for large, distributed data environments,
• responsibility for designing end-to-end solutions in accordance with business requirements and architectural standards,
• collaborating with business stakeholders and technical teams to refine requirements,
• verifying designs prepared by other architects and technical teams,
• defining best practices in data architecture and supporting their implementation,
• supporting the estimation process and identifying technical risks,
• supervising the compliance of solutions with corporate architecture,
• collaborating with teams responsible for development, integration, testing, and deployment.

Requirements

min. 7 years of experience in projects related to data architecture and cloud solutions, very good knowledge of Cloudera CDH/CDP platforms (On-Premise and Cloud), experience in designing solutions based on AWS, practical knowledge of Big Data technologies, in particular: Apache Spark, Kafka, Cassandra, HBase, experience in building ETL processes and Data Pipelines using tools such as Apache Airflow, Apache NiFi, advanced knowledge of English, good knowledge of data architecture principles and modern engineering practices.

Must have: AWS, Cloudera