Data Engineer
Must-have:PythonJavaAWSAzureGoogle CloudDockerKubernetesDataCI/CD
Machine translation — original language: Hebrew.Show original
We are looking for a talented and experienced Data Engineer to lead the planning, construction, and maintenance of the company's Data infrastructures. In this role, you will be responsible for connecting diverse data sources, developing Data Pipelines (ETL), planning Data Warehouses, and ensuring the availability, reliability, and quality of information for the Analytics, BI, and Data Science teams within the company.
Responsibilities
- Planning, development, and maintenance of large-scale Data Pipelines (ETL/ELT) for databases and data warehouses.
- Optimization and performance improvement of real-time data processing (Streaming) and Batch processing.
- Building and managing Data Warehouse infrastructures (Data Warehouses & Data Lakes).
- Close collaboration with Development, Analytics, and Product teams to understand Data needs and define the correct data architecture.
- Ensuring data quality, security, reliability, and privacy (Data Governance & Data Quality).
- Troubleshooting and solving complex problems in Production environments.
Requirements
- At least 2 years of experience in a Data Engineer role.
- Excellent command of Python or Scala / Java.
- Proven experience working with complex SQL queries and database optimization (Relational & NoSQL).
- Experience working with cloud Data Warehouse technologies (such as Snowflake, BigQuery, Redshift).
- Experience working with orchestration and Workflow management tools (such as Apache Airflow, Prefect, Dagster).
- Experience working in cloud environments (AWS / GCP / Azure).
- High level of English (Reading, Writing, and Speaking).
Advantages
- Experience with Big Data and Streaming technologies (such as Apache Spark, Kafka, Flink).
- Experience working with Data Transformation tools like dbt.
- Experience working with Docker, Kubernetes, and CI/CD of pipelines.
- Background working alongside Data Science and MLOps teams.