Senior Data Engineer (60%DE 40%BE)
Main Tech Stack: Node.js / NestJS, Python / Airflow, SQL / dbt, Snowflake, PostgreSQL, Kafka
Scope of Work:
Backend / Data platform focused. No end-user UI. Batch-based processing. Build a batch data pipeline to ingest, validate, transform, and serve enrollment data from multiple sources. Key Responsibilities:
Data ingestion: Design, build, and maintain scalable batch data pipelines to ingest enrollment data from disparate sources using Python, Airflow, and SQL. Data quality & validation: Implement robust data validation rules and data quality frameworks to ensure accuracy, consistency, and reliability across all datasets. Data transformation: Perform efficient batch data transformations and historical tracking using dbt, Snowflake, and PostgreSQL. Historical tracking REST API development: Build high-performance RESTful APIs using Node.js / NestJS to serve processed enrollment data to downstream systems. Event publishing: Integrate asynchronous event publishing/messaging workflows using Apache Kafka. Job Requirements Experience: 5+ years of experience as a Data Engineer, Backend Engineer, or Data Platform Engineer. Core Tech Stack: Backend: Strong proficiency in Node.js / NestJS. Data & Orchestration: Solid experience with Python, Apache Airflow, and dbt. Databases & Warehousing: Hands-on experience with Snowflake, PostgreSQL, and advanced SQL. Messaging/Events: Experience with Apache Kafka or similar messaging systems. Domain & Concept Knowledge: Strong understanding of batch processing architecture, data modeling, historical data tracking (SCD), and REST API design. Language Proficiency: Upper-Intermediate English or higher. Ability to communicate clearly and directly with native English speakers in daily meetings and technical discussions. Soft Skills: Self-motivated, strong problem-solving mindset, capable of working independently and taking full ownership in a remote environment. Team Structure:
Work closely with 1–2 team members in Poland and 1 member in Vietnam (Data team). Current Vietnam team consists of 4 members (2 Developers and 2 Testers), mainly supporting automation and legacy applications. English Requirement: Upper-Intermediate or higher. Must be able to communicate and work directly with native English speakers.
Skills: Data Processing, Power BI, Data Engineering, Data Platform