Cloud engineer (databricks, aws, azure) - johannesburg - up to r1.08mil
E-Merge
About the role
We are seeking a specialised Cloud Engineer to design, secure, and maintain the infrastructure that powers modern data platforms. This role focuses on the unique requirements of data workloads, including large-scale storage, high-throughput networking, and compute clusters for Spark/SQL. You will bridge Dev Ops and Data Engineering, ensuring data teams have robust, secure, and automated platforms to build pipelines, models, and analytics solutions. You will manage the 'plumbing' of the data ecosystem, primarily working with Databricks, AWS, and Azure. Responsibilities Platform Architecture: Design and deploy scalable cloud infrastructure for data lakes and analytics using Infrastructure as Code (Terraform). Security & Governance: Implement identity management (IAM/Entra ID), network security (Private Link/VPC), and data governance (Unity Catalog). Automation: Build CI/CD pipelines to automate provisioning of compute resources and workspaces. Observability: Monitor cost, performance, and reliability of data workloads, ensuring efficient resource use. Enable Data Teams: Create self-service infrastructure patterns that let Data Engineers deploy pipelines without managing underlying servers. Requirements Minimum of 5 years professional experience in cloud engineering, with exposure to data engineering and Databricks highly desirable. Infrastructure as Code: Terraform (modules, state, workspaces), plus Cloud Formation, Bicep, or Crossplane. Containerisation & Orchestration: Docker, Kubernetes (EKS, AKS, or self-managed). CI/CD & Version Control: Git, Azure Dev Ops, Git Hub Actions. Scripting & Automation: Python, Bash, CLIs (DBX, AWS, Azure), REST APIs. Cloud Security: Least Privilege access, RBAC, encryption, secrets management. Cloud Networking: VNETs/VPCs, Private Link, DNS, Firewalls Data Platform Architecture: Medallion architecture, Delta Lake, Data Vault. Observability: Cost management, logging (Cloud Watch, Azure Monitor), alerting systems. Data Workload Understanding: Familiarity with Py Spark, SQL, DBT, Spark Structured Streaming. Workspace administration via Terraform, Unity Catalog configuration, Cluster Policies, Instance Profiles, Private Link & VNet Injection, Jobs, Delta Live Tables, Airflow integration, MLflow, Mosaic AI, Vector The Reference Number for this position is NG61051 which is a Permanent, hybrid role in Johannesburg offering a salary of up to R1.08mil per annum salary negotiable based on experience. E-mail Nokuthula on or call her for a chat on to discuss this and other opportunities. #J-18808-Ljbffr
Don't send a generic resume
Paste this job description into Mimi and get a resume tailored to exactly what the hiring team is looking for.
Get started free