Data Engineer

Our client, an IT services, software development, and dataengineering consulting company, is looking for a Data Engineer to join their team.

Responsibilities:

• Design,develop,and maintain scalable and high-performancedata pipeline architectures that support business and analytical requirements.
• Build andmanage large, complex datasets that meet functionaland non-functional business requirements, ensuring data quality, reliability,and accessibility.
• Identify andimplement process improvements by automating manualworkflows, optimizing data delivery, and redesigning infrastructure to improvescalability, efficiency, and performance.
• Develop robustdata infrastructure for the extraction,transformation, and loading (ETL) of data from diverse sources using SQL andAWS big data technologies.
• Developanalytics solutions and tools that leverage datapipelines to generate actionable insights into customer acquisition,operational efficiency, and other key business performance metrics.
• Collaboratecross-functionally with Executive, Product, Data,and Design teams to resolve data-related technical challenges and supportevolving data infrastructure requirements.
• Design andimplement secure, distributed data architecturesthat ensure data is appropriately segregated and protected across nationalboundaries, data centers, and AWS regions.
• Develop datatools and platforms that enable analytics and datascience teams to efficiently explore, analyze, and optimize data to supportproduct innovation and business growth.
• Partner withdata and analytics specialists to continuouslyenhance the functionality, reliability, scalability, and performance of datasystems.
• Champion dataengineering best practices, ensuring that dataplatforms and pipelines are scalable, secure, maintainable, and aligned withevolving business needs.

Requirements:

• Bachelor's Degree in Computer Science, Software Engineering, Information Technology, Information Systems, or a related discipline.
• Around 3 years of software development experience
• Strong analytical and problem-solving skills.
• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases
• Experience building and optimising big data pipelines, architectures and data sets
• Experience in performing root cause analysis on internal and external data and processes to address specific business questions and identify opportunities for improvement
• Build processes supporting data transformation, data structures, metadata, dependency and workload management
• Experience in manipulating, processing and extracting value from large disconnected datasets
• Knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores
• Experience with big data tools: Hadoop, Spark, Kafka, etc., relational SQL and NoSQL databases, data pipeline and workflow management tools, AWS cloud services, stream processing systems and object-oriented/object function scripting languages such as Python, Java, C++, Scala, etc.

We regret that only shortlisted candidates will be notified.

EALicense No.: 08C3209 RegistrationNo.: R1101742