Cloud Platform Engineer

Job Summary

We are seeking an experienced Cloud Platform Engineer to support the deployment, automation, and management of cloud-native platforms, data engineering workflows, and containerized applications within Azure and Databricks environments. The ideal candidate will have strong expertise in CI/CD automation, infrastructure provisioning, container orchestration, and cloud platform engineering.

This role requires hands-on experience with Databricks deployments, Terraform, Azure services, Kubernetes-based platforms, and modern DevOps automation practices to support scalable and reliable enterprise cloud solutions.

Key Responsibilities

• Manage and execute environment promotion and release management activities across development, testing, staging, and production environments. • Deploy and manage data engineering workflows, machine learning models, applications, and agents within Databricks environments. • Lead containerized application deployments using Docker, Azure Kubernetes Service (AKS), and Azure Container Apps (ACA). • Design, build, and maintain CI/CD pipelines to automate code validation, testing, deployment, and release processes. • Implement monitoring, alerting, and observability solutions for Azure infrastructure and Databricks workflows to ensure platform reliability and availability. • Develop reusable and modular YAML configurations for CI/CD pipelines, Kubernetes deployments, and automation workflows. • Provision and manage cloud infrastructure and Databricks resources using Terraform modules. • Support Azure container registries, orchestration platforms, networking configurations, and cloud-native infrastructure operations. • Develop automation scripts and utilities using Python, Bash, and YAML. • Troubleshoot deployment, infrastructure, networking, and automation issues across cloud platforms. • Collaborate with engineering, DevOps, and data platform teams to improve platform scalability, automation, and operational efficiency.

Required Qualifications

• Strong expertise in writing clean, modular, and reusable YAML configurations for CI/CD pipelines and Kubernetes environments. • Proven hands-on experience deploying and managing Databricks assets using Databricks Asset Bundles (DABs) and Databricks CLI. • Experience writing Terraform modules for cloud infrastructure provisioning and Databricks provider management. • Strong understanding of Microsoft Azure services including Azure Container Registry (ACR), Azure Kubernetes Service (AKS), Azure Container Apps (ACA), and Azure networking. • Strong experience with CI/CD orchestration tools such as Azure DevOps, Azure Pipelines, GitHub Actions, or GitLab CI. • Strong scripting and automation skills using Python, Bash, and YAML. • Hands-on experience with Docker and containerized application deployments. • Experience implementing monitoring and observability solutions for cloud and data platforms. • Strong troubleshooting, analytical, and problem-solving skills.

Preferred Qualifications

• Experience supporting enterprise-scale cloud-native platforms and data engineering ecosystems. • Familiarity with machine learning deployment workflows and MLOps practices. • Experience with Infrastructure as Code (IaC) and DevOps best practices. • Strong collaboration and communication skills within cross-functional teams.