Data Engineer

Context

Integrated into the "Bronze" team, you will contribute to the construction and evolution of data pipelines in a high-volume environment.

Your missions

• Collect and integrate data from heterogeneous sources
• Design and maintain robust and scalable data pipelines
• Structure and organize data storage (Data Lake)
• Participate in the implementation of data infrastructures on GCP
• Develop and maintain CI/CD workflows
• Ensure data quality, security, and governance
• Support teams in data exploitation
• Contribute to documentation and best practices

Technical Stack

• Python, SQL, Spark
• Airflow
• GCP (BigQuery, Dataproc, PubSub, Cloud Storage)
• Delta Lake
• Terraform / Terragrunt
• GitLab CI/CD

We are looking for an experienced Data Engineer capable of working on the entire data processing chain.

Required Skills

• Significant experience in Data Engineering (5 years minimum)
• Proficiency in Python and SQL
• Good experience with Spark
• Experience with GCP (BigQuery essential)
• Experience in setting up data pipelines
• Knowledge of Data Lake / Delta Lake architectures
• Proficiency with orchestration tools (Airflow)
• Experience in CI/CD (GitLab)
• Knowledge of infrastructure as code tools (Terraform)
• Good understanding of data governance and quality issues

Soft skills

• Ability to simplify technical subjects
• Collaborative spirit
• Autonomy and rigor
• Good communication