Senior Python Data Engineer
Company Description
A consulting and development company specializing in scaling innovative projects, Visian's mission is to detect, accelerate, and industrialize new uses of digital, IoT, and data.
Visian has chosen to specialize in Python, and Visian consultants have even gone as far as creating the PySquad to support each other and develop a center of excellence around common practices and standards. The PySquad's mission is to effectively respond to the challenges of development, acceleration, and industrialization of innovative projects.
Motivated by challenges, the desire to upskill, the wish to share knowledge, and the desire to continuously enrich themselves through the input of others, Visian consultants form a dynamic team, full of ideas and ambition.
Job Description
Within Visian and with our clients, you will be required to carry out missions including the following tasks:
- Identify business problems and translate them into Data problems
- Present results and lead business workshops to guide developments
- Design and implement data models and choose the associated storage types
- Design and implement scalable data processing pipelines (data cleaning, partitioning, transformation, normalization, etc.)
- Contribute to the development of "infrastructure-as-code", APIs, software tests, and CI/CD workflows on the platform
- Contribute to the industrialization and run process of Data Science models
- Oversee the automation of model monitoring in order to manage their lifecycle and retrain or evolve them when quality decreases
- Lead communities around data and cloud topics
- Perform technological monitoring
Qualifications
- Experienced Engineer
- Mastery of the Python language
- Very good knowledge of Java or Scala
- Very good knowledge of AWS, Azure, and/or GCP Cloud services
- Knowledge of serverless architectures
- Knowledge of SQL and NoSQL databases
- Experience in large-scale data processing using distributed systems such as Spark
- Sensitivity to DevOps culture and software craftsmanship
- Experience in data governance (timeseries, databases, Big Data, etc.) and Machine Learning
- Working in multidisciplinary teams (Software Engineers, Architects, Data Scientists, Product Owners, Scrum Masters)
- Oriented towards code quality, pair programming, or Test driven development
- Professional English