Ingénieur data plateforme de données azur Projet EPE

General
BDC is seeking the services of 1 Senior Data Engineer Azure Data Lake Specialist.
This consultant will be an integral part of the Azure Data Platform team, supporting them in a project to add data from multiple sources and send it to a marketing tool.
a project to add data from multiple sources and send this data to a marketing tool:
o Use of Azure Data Factory to ingest data into the data lake,
o Use of Databricks for loading, transforming and storing data in
parquet/delta tables,
o Use spark/scala to develop the loading library.
o Participate in the addition of new data sources to the data lake as part of the evolution of BDC's external portal.
external portal
o Participate in the evolution of the libraries developed for loading the data lake.
The mandate aiming to start around January 25, 2021 will be for an initial period of 6 months renewable.
Experience
The consultant must have the following experience:
o 5 years experience in spark/scala development
o 5 years' experience on databricks
o Experience on Azure Data lake and Azure data factory
o Experience on Azure DevOps an asset
Skills and knowledge
o Ability to integrate quickly into a new environment
o Autonomy, initiative and organizational skills
o Excellent teamwork skills
o Excellent written and verbal communication skills - French and English