Big Data Developer

Together with our Partner, one of the European leaders in the banking industry, we are looking for an experienced person to implement projects as a Big Data Engineer.

Projects concern B2B and B2C banking ➡️ platforms for large loans, professional loans, and applications supporting digital transformation.

WE OFFER:

• A new way of applying with an AI Recruiter (AIR) – during the process, you can talk to a virtual recruiter 24/7, without waiting for a phone call. The final decision is always made by the Project Manager.
• Cooperation in a project model, with settlement based on stages and acceptance protocols for individual deliverables.
• Support from Connectis regarding administrative and settlement matters related to the cooperation.
• Participation in industry events and technological meetups.
• Service delivery in Warsaw (approximately 3x a week from the office).
• 5,000 PLN for referring friends to our projects.
• Flexible B2B cooperation form.
• Fast and remote process.

Thank you for all applications. We kindly inform you that we will contact selected individuals. 13563/RJ

Daily tasks

• Designing and implementing pipelines for ingest, transformation, and processing of large data volumes.
• Industrialization of data processing solutions with an emphasis on scalability, reliability, and fault tolerance.
• Development and optimization of Spark/Scala jobs (batch processing, data mapping, performance tuning).
• Participation in Big Data architecture design and recommending technological solutions.
• Analysis of data sources and translating business requirements into technical specifications.
• Code review and ensuring code quality, TDD/BDD standards, and DevOps best practices.
• Production support (L3), troubleshooting, and identification of technical risks.
• Creating documentation and test plans in an Agile/Scrum environment.

Requirements

• Minimum 4 years of commercial experience in the field of Data Engineering or Software Engineering in a Big Data environment.
• Advanced knowledge and practical experience working with Apache Spark, Hive, and SQL.
• Deep understanding and experience in creating testable code according to the TDD approach.
• Higher education: Computer Science, Software Engineering, or related.
• Solid, practical experience in programming in Java.
• Very good knowledge of English (min. C1).

Nice to have:

• Practical experience in programming in Scala.
• CI/CD (Jenkins, GitLab CI, or similar), Git flow, branching strategies.
• Python (especially in the context of Airflow and pipeline orchestration).
• Experience with Azure (ADF, ADLS, Databricks, or similar services).
• Knowledge of microservices architecture and REST API.

Must have: Spark, Java, Hive, SQL, TDD, Agile

Nice to have: Scala, CI/CD, Python, Airflow, Azure