Senior Data Engineer
Must-have:PythonAWSGoogle CloudDockerKubernetesCloudDataAI
Responsibilities:
Design and implement ETL processes for data transformation and preparation Deploy machine learning models to production environments Manage data pipelines for analytics and operational use Ensure data accuracy and integrity across multiple sources and systems Collaborate with data scientists to support NLP algorithms and analytics
Requirements:
Experience in data engineering within a production environment Advanced knowledge of Python and Linux shell scripting Experience with SQL/NoSQL databases (e.g., Redshift, Postgres, MongoDB) Proficiency in building stream processing systems using Kafka Familiarity with Docker, Kubernetes, and cloud services (AWS, GCP)