About the mission
We are looking for a Senior Data Engineer to join our ICT & Data Architecture department. The role involves maintaining and expanding the Azure Data Platform, ensuring data quality, and providing support for existing data products. The ideal candidate will have proven experience in data engineering and relevant programming languages.
Read the full description
Overview
We are looking for a Senior Data Engineer for our ICT & Data Architecture department, Data & Analytics architecture service. We are investing in a new electric fleet, which brings several challenges, including unlocking the technical data of the vehicles and normalizing the data according to standards.Key Responsibilities
The responsibilities of the Data & Analytics Architect/Data Engineer include:Maintaining and expanding the Azure Data Platform:
• Setting up various integrations with source data (e.g., API calls, IoT Hub integration, etc.)• Setting up ETL pipelines in Python codebase (using Azure Batch & Airflow for batch processing, using Azure Functions & Azure Event Hub for real-time processing)
• Refactoring/updating existing code
Ensuring data quality by:
• Coordination with suppliers/external partners• Process monitoring (e.g., Grafana, Azure Log Analytics, etc.) and content monitoring (e.g., non-communicating vehicles)
• Documenting processes/available data
Providing support for existing data products:
• Real-time dashboard in Power BI, with stream analytics input• Historical report in Streamlit
Skills & Experience
Proven experience as a Data Engineer
Proven experience with programming languages such as Python, Java, or Scala for developing data streams and ETL processes
Proven experience in designing and implementing Extract, Transform, Load (ETL) processes
Proven experience with databases
Proven experience with PySpark - CI/CD
Proven experience with scripting (Shell, Perl, Python)
Proven experience with Azure Batch & Airflow for batch processing
Proven experience with Azure Functions & Azure Event Hub for real-time processing
Proven experience with GIT-Streamlit
Proven experience in setting up various integrations with source data (e.g., API calls, IoT Hub integration, etc.)
Languages
English: Very good (C1)
French: Good (B2)
Additional Info
Preferred start date: 13/04/2026Preferred end date: 31/03/2027
Number requested: 1
Working hours: 1760
Employment percentage: 100
Remote work possible: Yes.
What you'll do
- Maintaining and expanding the Azure Data Platform
- Setting up various integrations with source data (e.g., API calls, IoT Hub integration, etc.)
- Setting up ETL pipelines in Python codebase (using Azure Batch & Airflow for batch processing, using Azure Functions & Azure Event Hub for real-time processing)
- Refactoring/updating existing code
- Ensuring data quality by coordination with suppliers/external partners
- Process monitoring (e.g., Grafana, Azure Log Analytics, etc.) and content monitoring (e.g., non-communicating vehicles)
- Documenting processes/available data
- Providing support for existing data products including a real-time dashboard in Power BI and a historical report in Streamlit
What we're looking for
- Proven experience as a Data Engineer
- Proven experience with programming languages such as Python, Java, or Scala for developing data streams and ETL processes
- Proven experience in designing and implementing Extract, Transform, Load (ETL) processes
- Proven experience with databases
- Proven experience with PySpark - CI/CD
- Proven experience with scripting (Shell, Perl, Python)
- Proven experience with Azure Batch & Airflow for batch processing
- Proven experience with Azure Functions & Azure Event Hub for real-time processing
- Proven experience with GIT-Streamlit
- Proven experience in setting up various integrations with source data (e.g., API calls, IoT Hub integration, etc.)
Skills
- Python
- Java
- Scala
- Azure
- ETL
- PySpark
- CI/CD
- Shell
- Perl
- GIT
- Streamlit
- Azure Batch
- Airflow
- Azure Functions
- Azure Event Hub