Senior Data Engineer – Python, Spark, AWS

We’re looking for a Senior Data Engineer to join a highly skilled team responsible for building a scalable, multitenant data platform that powers data ingestion, transformation, cataloging, and distribution for internal and external stakeholders. This role is central to designing robust data pipelines, integrating modern data lakehouse components, and supporting the company’s AWS-based infrastructure.

Daily tasks

• Design and build scalable data ingestion pipelines in AWS
• Work extensively with Databricks, including Unity Catalog, streaming, Delta Lake, and data transformation tools
• Lead technical delivery and implementation of core platform components across raw, normalized, operational, and historical layers
• Collaborate with engineering managers and cross-functional teams across the US and Poland
• Drive technical excellence by improving team processes, architecture standards, and engineering best practices
• Support and consult with stakeholders to ensure successful delivery of data-driven solutions
• Contribute to the growth and maturity of the team’s cloud and data engineering capabilities

Requirements

5+ years of experience in Python and strong software engineering skills

Solid knowledge of AWS cloud services and best practices

Experience building scalable Spark pipelines in PySpark or Scala

Practical experience with Spark Streaming for low-latency pipelines

Familiarity with Delta Lake and modern data lakehouse architectures

Hands-on experience with Kubernetes and container orchestration

Experience with MongoDB and other NoSQL data stores

Understanding of microservices and event-driven architecture

Excellent communication skills and ability to work in a collaborative, global team

Commitment to high standards of ethics, quality, and delivery

Nice to Have:

Familiarity with Machine Learning , AI models , or Data Science workflows

Must have: Python, AWS, Cloud, Spark, PySpark, Scala, Kubernetes, MongoDB, NoSQL, Microservices, Communication skills

Nice to have: Machine learning, AI, Data science