Big Data Engineer (Java/ Spark)
Your tasks
- Designing and implementing solutions for processing large datasets
- Creating and developing data pipelines based on Spark
- Analyzing data from multiple sources and translating business requirements into technical solutions
- Ensuring the quality, performance, and reliability of data processes; Industrialization of data processing (scalability, resilience, automation)
- Participating in code review and initiatives to improve code quality
- Working in Agile methodology (Scrum, 2–3 week sprints)
- Collaborating with international teams and managing dependencies within a global release train
- Application support and resolving production issues
- Documenting technical solutions and preparing tests
- Participating in defining Big Data architecture
- Identifying project risks and proposing corrective actions
- Hybrid work - 3 days a week from Warsaw
- Rate: up to 180 PLN net + VAT/H/B2B
Requirements
- Min. 4 years of experience in Big Data Engineering (experience in banking is welcome)
- Very good knowledge of: Spark, Java, SQL, Hive
- Knowledge of tools and technologies: (welcome) Python, CI/CD, DevOps, Airflow, API, microservices, Git
- Higher technical education (computer science, software engineering, or related)
- Very good command of English (French will be an additional asset)
- Analytical and problem-solving skills
- Proactivity and teamwork skills
- Ability to work in an international environment and across different time zones
Must have: Big data, Data engineering, Spark, Java, SQL, Hive, Python, CI/CD, DevOps, Airflow, API, Microservices, Git, Analytical skills
What we offer
Hi! You will find what you are looking for with us - come and see! What we have for you:
- Stable cooperation
Technological challenges and working with modern solutions. Internal Mobility - you don't have to change companies to change projects
- SCALO Ambassadors
Develop technical and presales competencies, influence the direction of the organization's development, and support others
- Personal brand building
Create valuable content, share knowledge and experience, appear as an expert at events (e.g., ProMeet) - develop your brand in a natural way
- Benefit box
Full medical care, MultiSport card, and a wide range of Motivizer offers - choose benefits that take care of your health, energy, and daily comfort
- Referral program
Refer an IT friend, and we will take care of the rest – they get a new project, you get a bonus. A win–win in its purest form
- Integrations and company events
Joint outings, company events, and opportunities to get to know each other outside of projects – because good relationships create the best teams