Senior / Lead Data Engineer Environmental Data
π Looking for your next job or project within Data & AI? Then you've come to the right place at Summ.link! π
Who is Summ.link? We are a dynamic company that delivers both Time and Materials (T&M) as well as project work for companies of all sizes, from small and medium-sized enterprises to large corporations. Our expertise extends across a wide range of services, including data platforms (Azure, Databricks, Collibra), DevOps, SecOps, MLOps, AIOps, Data Engineering and Data Science. _Our goal is to create unique value from every customer's data!_ππ‘
To emphasize that our knowledge of Data & AI is not only limited to the projects we execute, but is also deeply rooted within our own team. This gives us, as consultants, a unique and well-founded insight into the market, the required profiles, and the freelancers we work with. π€ Because knowledge is power, right?
It is our mission to make the perfect match between talented Data & AI professionals and innovative companies. Strong relationships, based on open communication, are our strength. With us, you are a valued professional with a unique story. Let's find your next Data & AI challenge together! π
Make the unknown, known! πβ¨
Are you a Senior / Lead Data Engineer with a strong entrepreneurial spirit? π
As a Data Engineer, you will help us implement the data lake to collect, process, and store environmental data from various sites.
Specifically, we expect the IT Data Engineer to:
- Develop and maintain scalable data pipelines using Azure Databricks.
- Collaborate with business data analysts to understand data needs and deliver solutions.
- Implement data integration and transformation processes from various sources, including REST API's.
- Optimize data flows and troubleshoot with a view to performance and reliability.
- Ensure data quality and consistency across various structured and unstructured data sources.
- Stay up to date with the latest trends and best practices within data engineering, Databricks and data integration technologies.
Our client follows a Microsoft-first strategy and builds its data landscape on Microsoft Azure Cloud solutions such as Azure Data Lake Storage Gen2, Azure Databricks, Azure Data Factory, Azure SQL Services, etc.
- Demonstrable experience as a Data Engineer with a strong focus on Azure Databricks and related technologies within the Microsoft data ecosystem.
- Familiar with the lakehouse medallion architecture.
- Proficient in SQL, Python and Apache Spark.
- Thorough knowledge of REST API's, including how to consume them in a secure and efficient manner (for example via Python/Databricks notebooks); experience with retrieving and transforming JSON/XML data from web API's is a major plus.
- Experience with data management & governance via Unity Catalog is a plus.
- Willingness and knowledge to build (technical) reports in Power BI yourself.
- Documenting your work is a matter of course for you during analyses and development activities (for example in Wiki, DevOps, β¦).
- You speak fluent English. Other European languages such as French, Dutch or Spanish are a plus.
Ready to make a difference? Let's have a brief introduction! π
At Summ.link, your career wishes are central.π Whether you are permanently employed and want to give your career a boost, or you are a freelancer looking for the perfect project, we understand and respect your unique needs. We offer flexible solutions that truly suit you. π€β¨ Come join the team! π