About the mission
We are looking for a Data Engineer with expertise in Databricks to develop and maintain complex data transformation pipelines. The role involves designing scalable data pipelines, managing data ingestion processes, and ensuring data quality and security.
Read the full description
Overview
We are looking for a Data Engineer with expertise in Databricks. You will demonstrate and use your developer experience to develop and maintain complex data transformation pipelines under specific guidelines.Key Responsibilities
Design, develop and maintain scalable data pipelines
Manage data ingestion processes from various sources (xml ingestion, Kafka, etc.)
Implement and optimize ETL (Extract, Transform, Load) processes to ensure efficient data transformation and integration
Ensure data quality, integrity, and security across all data pipelines
Monitor and troubleshoot data pipeline performance, implementing necessary maintenance and updates
Document data pipeline processes, technical specifications and best practices
Realize knowledge transfer towards the Data engineer team which will take over the responsibility to run the platform in the future
Skills & Experience
Fluent in French-English or Dutch-English is a MUST (and understanding of other language NL/FR)
Languages
English + French or Dutch
Additional Info
Preferred start date: 01/03/2026
Preferred end date: 31/12/2026
Number requested: 1
Assignment type: ITS
Department: Electrabel - M&S-IT - Functional Area (BE.EBL.M&S.FA.ITS)
Full-time position
Working range: Hours worked
Renewal options possible: Yes, 6 to 12 months
Contractual info: Answering the quotation request implies full acceptance of the attached conditions. No adjustments or negotiations are possible afterwards. Collaboration will go through a broker.
What you'll do
- Design, develop and maintain scalable data pipelines
- Manage data ingestion processes from various sources (xml ingestion, Kafka, etc.)
- Implement and optimize ETL processes to ensure efficient data transformation and integration
- Ensure data quality, integrity, and security across all data pipelines
- Monitor and troubleshoot data pipeline performance, implementing necessary maintenance and updates
- Document data pipeline processes, technical specifications and best practices
- Realize knowledge transfer towards the Data engineer team which will take over the responsibility to run the platform in the future
What we're looking for
- Expert in Databricks
- Experience in developing and maintaining complex data transformation pipelines
- Familiarity with data ingestion processes from various sources (xml ingestion, Kafka, etc.)
- Experience in implementing and optimizing ETL processes
- Ability to ensure data quality, integrity, and security
- Experience in monitoring and troubleshooting data pipeline performance
- Documentation skills for data pipeline processes and technical specifications
- Fluent in French-English or Dutch-English
Skills
- Databricks
- Python
- SQL
- DATAIKU
- SAS