Data Scientist / Full Stack Data Engineer
About YellowIpe Our mission is to inspire the connection between technology and people; we foster the best in our professionals through our expertise in finding and attracting the best talent for the best projects. Focus on People, Collaboration, and Commitment are the pillars that guide us on this journey.
Join the yellow team as our new Data Scientist / Full Stack Data Engineer!
Responsibilities: Develop end-to-end data functionalities on a Big Data platform on AWS, ensuring their quality and scalability; Actively participate in strategic discussions regarding solution architecture, data flows, and necessary processes, contributing technical and business insights; Create, maintain, and optimize data processing and analysis applications, integrating data engineering and data science methodologies; Create proofs of concept to validate innovative approaches and technologies that meet project needs; Develop production-ready solutions, following DevOps practices, including automated testing and secure implementations in development, quality, and production environments; Monitor implemented solutions, supporting debugging and promoting continuous improvements to ensure performance and security; Work with relational and NoSQL databases, implementing efficient queries to optimize data access; Support data extraction and perform exploratory analyses to discover relevant patterns and insights; Contribute to the implementation of models in production environments, managing their lifecycle; Maintain up-to-date and accurate technical documentation, covering workflows and solutions in use; Manage and monitor the technical debt backlog, prioritizing issues that impact operational efficiency; Support infrastructure change requests, ensuring alignment between data needs and systems architecture.
Requirements: Up to 5 years of experience in a relevant role, preferably in data and software engineering environments; Bachelor's degree in Software Engineering, Computer Engineering, or a similar field; Solid experience in Python, especially for data manipulation and processing using libraries such as Pandas and NumPy; Deep understanding of SQL and the ability to write complex queries for data analysis and integration; Experience in programming and debugging in software development environments; Experience with relational databases (such as PostgreSQL or MySQL) and NoSQL (such as MongoDB or DynamoDB); Experience deploying models in production environments and managing their lifecycle using tools like MLflow or Kubeflow; Genuine interest in Data Science and its practical applications; Good written and verbal communication skills, with the ability to convey technical concepts to non-technical audiences; Ability to work autonomously and proactively, demonstrating initiative in problem-solving; Ability to work in collaborative environments and with global teams, adding value to technical discussions; Critical thinking and problem-solving skills to tackle complex challenges; Knowledge of agile methodologies, tools such as Jira and Confluence; Solid commitment to the quality of the work produced; Proficiency in English (mandatory).
Differentials: Experience with AWS services, such as S3, Lambda, Athena, EC2, Glue, CDK / CloudFormation, Step Functions, Batch or Fargate, applying them to Big Data solutions; Practical knowledge in Spark / PySpark for large-scale processing; Familiarity with version control systems such as Git for efficient team collaboration; Experience with Jupyter Notebooks, promoting an interactive environment for development and code sharing; Experience in application development or in production environments, understanding the importance of collaboration between development and operations; Knowledge of the Energy and Utilities market, bringing domain insights to the developed solutions; Understanding of GDPR regulations and their application in data science projects; Proficiency in Portuguese is valued; Proactive and autonomous mindset, demonstrating a willingness to learn new skills and technologies; Strong team spirit, collaborating for collective success.
Apply for this opportunity through our website!