Senior Data Engineer - IT Contracting

The end client is a company from the banking industry. Industry: Technology & Telecoms Area: IT Data Analysis We offer

Work in a hybrid model (Gdańsk - 3 days of office work per week)

B2B contract via Michael Page (First contract until the end of the year with a probability of extension)

Project start date: ASAP

Daily tasks

• Designing and developing solutions for processing large volumes of data.
• Creating and optimizing ETL processes and data transformations.
• Analyzing and implementing complex business requirements in the form of efficient SQL queries.
• Developing solutions based on Hadoop and Spark.
• Collaborating with business and technical teams to deliver reporting solutions.
• Providing L3 support for production environments.
• Collaborating with Production Assurance teams regarding problem diagnosis and resolution.
• Participating in improving CI/CD processes and deployment automation.

Requirements

5+ years of experience in a Data Engineer position.

Experience working with distributed data processing.

Very good knowledge of SQL and the ability to translate complex business requirements into technical solutions.

Experience in production support (L3 Support).

Ability to communicate technical issues in a way that is understandable to the business.

Very good knowledge of the English language.

Must have IT skills: Apache Hadoop, Apache Spark, Scala, SQL and data transformations, Workflow orchestration (Oozie, Airflow), CI/CD (Git, Jenkins, Pull Requests/Code Review), Kafka and event-driven architectures

Must have: SQL, Apache Hadoop, Spark, Scala, Airflow, CD, Git, Jenkins, Kafka