BI
Senior Data Engineer with Kubernetes & GCP Experience
BURGEON IT SERVICES
Toronto · Hybrid Contract Senior 1w ago
About the role
Job Description
- Looking for a Senior Data Engineer who have at least 10 years’ experience in Design, develop, and maintain robust data pipelines and architectures supporting batch and real time data processing.
- Experience in implementing real time data streaming solutions using Apache Spark Streaming, Kafka, Flink, and related frameworks.
- Experience in Hadoop ecosystem, including Hive, Pig, Spark and Kafka.
- Expertise in Medallion architecture, Data Lakehouse, Unity Catalog and microservices
- Expertise in Implementing CI/CD pipelines, DevOps and experience in Kubernetes ,Terraform.
- Good communication skill and stakeholder Management
- Experience in application design using GCP, Databricks
Skills
Apache Spark StreamingCI/CDDatabricksDevOpsFlinkGCPHadoopHiveKafkaKubernetesMedallion ArchitectureMicroservicesPigPythonSparkTerraformUnity Catalog
Don't send a generic resume
Paste this job description into Mimi and get a resume tailored to exactly what the hiring team is looking for.
Get started free