Data Engineer

About YellowIpe

Our mission is to inspire the connection between technology and people. We nurture the best in our professionals through our expertise in finding and attracting top talent for the best projects. People Focus, Collaboration, and Commitment are the pillars that guide us on this journey.

Join the yellow team as our new Data Engineer!

Responsabilities:

• Design and lead scalable data architectures to support structured, semi-structured, time-series, and unstructured data across the company’s global operations;
• Develop unified data platforms that ensure secure, governed, and efficient access to enterprise-wide data;
• Build, manage, and optimize robust data pipelines integrating data sources such as ERP systems, IoT devices, iHistorian, web services, and external APIs;
• Leverage modern data engineering technologies, including Python, SQL, Spark, Delta Lake, Databricks, and Azure, to enable large-scale and high-performance data processing;
• Automate data workflows and maintain CI/CD pipelines to ensure platform operability, 24/7 availability, reliability, and efficient resource utilization;
• Collaborate closely with business stakeholders and IT teams to deliver impactful, scalable, and business-aligned data solutions across different functional domains;
• Continuously improve data platforms and systems by implementing innovative approaches to scalability, maintainability, performance, and reliability using the latest data technologies.

Requirements:

• Bachelor’s degree in Computer Science, Software Engineering, or a related Engineering field;
• 5+ years of professional experience developing data engineering solutions, tools, and software applications, with strong and proven experience in manufacturing environments;
• Manufacturing experience is essential for this role;
• At least 1 year of experience in system design and architecture;
• 5+ years of experience evaluating, selecting, and implementing data engineering and software technologies;
• Strong programming skills and proven experience working on complex software development projects;
• Solid experience with SQL, Python, Spark, Databricks, and Delta Lake;
• Experience with SQL and NoSQL databases and data storage technologies such as Azure Data Lake Storage;
• Experience developing data solutions, data models, APIs, and software applications using SQL, Python, and .NET;
• Working knowledge of Azure infrastructure management, resource deployment, system networking, and security;
• Experience with data visualization tools such as Power BI, Grafana, and Tableau;
• Knowledge of machine learning theory, with practical experience in developing machine learning solutions;
• Strong analytical and problem-solving skills, with the ability to translate complex business and technical requirements into scalable solutions;
• Excellent communication and collaboration skills, with the ability to work effectively with stakeholders and multidisciplinary IT teams.

Nice to have:

• Master’s or PhD degree in Computer Science or a related Engineering field;
• Hands-on programming experience with .NET / C#;
• Additional experience designing and implementing enterprise-scale data platforms;
• Experience with cloud-based data architectures and Azure services;
• Experience with IoT, industrial data, manufacturing systems, or time-series data platforms;
• Practical knowledge of machine learning development and deployment;
• Experience working with modern DevOps and CI/CD practices;
• Strong interest in emerging data engineering technologies and a proactive mindset towards continuous learning and improvement.

Important information:

• Contract type: Full-time
• Location: Bangalore, India
• Work model: On-site
• Level: Senior

Candidatura: Ver a vaga e candidatar-me na YellowIpe