Data Engineer
Meħtieġ:PythonJavaGitAWSAzureGoogle CloudDockerCloudDataCI/CDAI
We are looking for a Data Engineer to design, build, and maintain our core data infrastructure and scalable ETL/ELT pipelines. In this role, you will work closely with data scientists, analysts, and product teams to turn raw data into clean, reliable, and accessible formats that power business intelligence and machine learning workflows.
Key Responsibilities
- Pipeline Development: Design, build, and optimize scalable data ingestion and transformation pipelines (ETL/ELT) from various structured and unstructured sources.
- Data Architecture & Modeling: Architect, maintain, and evolve data warehouses, data lakes, and dimensional data models.
- Data Quality & Reliability: Implement automated testing, data quality checks, monitoring alerts, and schema validation to ensure high data integrity.
- Infrastructure Management: Configure and maintain cloud data infrastructure, storage solutions, and workflow orchestration tools.
- Cross-Functional Collaboration: Partner with software engineers, product managers, and data scientists to support downstream analytics and predictive models.
Required Qualifications & Skills
- Experience: [e.g., 2 to 5 years] of hands-on experience in data engineering or software development.
- Programming Languages: Proficiency in Python and/or Java / Scala.
- Database & Querying: Advanced SQL skills and experience with relational/NoSQL databases or modern cloud data warehouses (e.g., Snowflake, BigQuery, Redshift, PostgreSQL).
- Big Data & Processing Frameworks: Familiarity with distributed processing and streaming tools (e.g., Apache Spark, Kafka).
- Orchestration & Transformation: Experience with workflow managers like Apache Airflow and transformation tools like dbt.
- Cloud Platforms: Working knowledge of cloud providers such as AWS, Google Cloud Platform (GCP), or Microsoft Azure.
- Education: Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or a related quantitative field (or equivalent practical experience).
Preferred Qualifications
- Experience building event-driven or real-time streaming architectures.
- Knowledge of CI/CD practices, Git version control, and infrastructure-as-code (Terraform/Docker).
- Relevant cloud or industry certifications (e.g., Google Cloud Data Engineer, AWS Certified Data Analytics, Azure)