Data Engineer, Sr.

Accountabilities Design, develop, and maintain scalable ETL pipelines to support large-scale data migration and integration projects.

Build, configure, and optimize AWS-based data lake and warehouse solutions using services such as Glue, S3, Athena, Redshift, Lake Formation, Lambda, EventBridge, and Step Functions.

Develop Python scripts and database procedures to automate data processing, transformation, validation, and migration workflows.

Manage relational databases, including MySQL, SQL Server, and Aurora MySQL, with a focus on performance, replication, and reliability.

Configure and troubleshoot AWS data engineering services, including Glue Catalog, Hudi tables, SQS, and CloudFormation resources.

Monitor data platforms, identify performance bottlenecks, and implement improvements to ensure scalability, security, and operational excellence.

Collaborate with product, engineering, and business teams while contributing to Agile development processes and technical planning.

Requirements

Proven experience as a Data Engineer with strong expertise in AWS cloud data engineering and migration projects.

Hands-on experience with AWS services including S3, Athena, Glue, Redshift, Lake Formation, Lambda, Step Functions, EventBridge, CloudFormation, and RDS.

Strong knowledge of relational databases, including MySQL, SQL Server, and data warehouse architecture, particularly Amazon Redshift.

Proficiency in Python for scripting, automation, ETL development, and data transformation.

Experience working with structured and unstructured data, data cleansing, conversion, and large-scale ETL processes.

Knowledge of Hudi table management, AWS Glue Catalog, SQS, and cloud-based data lake implementations.

Familiarity with Agile methodologies and product-focused software development environments.

Excellent analytical, troubleshooting, communication, and leadership skills with the ability to work independently in a remote setting.

Experience with AWS Database Migration Service (DMS), Scala, or Aurora MySQL replication is considered an advantage.

Benefits

Fully remote work environment with flexibility to work from anywhere.

Competitive contract compensation based on experience.

Opportunity to work on large-scale cloud migration and modern data platform initiatives.

Exposure to a broad AWS ecosystem and advanced cloud-native technologies.

Collaborative Agile environment with high levels of ownership and technical autonomy.

Opportunity to contribute to innovative, product-driven engineering projects and expand cloud data engineering expertise.

How Jobgether works: We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team. We appreciate your interest and wish you the best!  Why Apply Through Jobgether? 

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

#LI-CL1