About the role :
We are seeking a skilled and experienced Data Engineer to join our team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure and pipelines. You will collaborate with cross-functional teams to gather requirements, build scalable solutions, and ensure the availability and reliability of our data systems.
Responsibilities:
●Design, develop, and implement scalable and efficient data pipelines in the cloud using Python, SQL, and relevant technologies.
● Build and maintain data infrastructure on platforms such as AWS, leveraging services like EMR, Redshift, and others.
● Collaborate with data scientists, analysts, and other stakeholders to understand their requirements and provide the necessary data solutions.
● Develop and optimize ETL (Extract, Transform, Load) processes to ensure the accuracy, completeness, and timeliness of data.
● Create and maintain data models, schemas, and database structures using PostgreSQL and other relevant database technologies.
● Experience reporting tools such as Superset, (good to have : Domo, or Tableau, Quicksight) to develop visually appealing and insightful data visualizations and dashboards.
● Monitor and optimize the performance and scalability of data systems, ensuring high availability and reliability.
● Implement and maintain data security and privacy measures to protect sensitive information.
● Collaborate with the engineering team to integrate data solutions into existing applications or build new applications as required.
● Stay up-to-date with industry trends, emerging technologies, and best practices in data engineering
Qualifications :
● Bachelor's or master's degree in Computer Science, Engineering, or a related field.
● Strong proficiency in Python and SQL for data manipulation, analysis, and scripting.
● Extensive experience with cloud platforms, particularly AWS, and working knowledge of services like EMR, Redshift, and S3.
● Solid understanding of data warehousing concepts and experience with relational databases like PostgreSQL.
● Familiarity with data visualization and reporting tools such as Superset, Domo, or Tableau.
● Experience with building and maintaining data pipelines using tools like Airflow.
● Knowledge of Python web frameworks like Flask or Django for building data-driven applications.
● Strong problem-solving and analytical skills, with a keen attention to detail.
● Excellent communication and collaboration skills, with the ability to work effectively in a team environment.
● Proven ability to work in a fast-paced environment, prioritize tasks, and meet deadlines.
● If you are a talented Data Engineer with a passion for leveraging data to drive insights and impact, we would love to hear from you.