Azure Data Engineer

Detailed Job Description

• 8-10+ years of experience in data platform or cloud administration, with strong focus on Azure Databricks.
• Hands‐on experience with Azure services including ADLS Gen2, Azure Networking, Azure Monitor, and ADF
• Lead onshore platform operations and administration for the Azure data platform, accountable for platform stability, security, and compliance, and serving as the escalation owner for P1/P2 platform incidents and change coordination
• Manage access and governance controls across Azure Portal, Entra ID/AD groups, RBAC, Key Vault/secret scopes, and platform components including Databricks workspaces/cluster policies, ADF/SHIR, ADLS ACLs/zones, and integration touchpoints such as Power BI gateway topology
• Establish and run platform observability and alert hygiene using Azure Monitor/Log Analytics/App Insights, Splunk, and operational scheduling visibility from Tidal, ensuring thresholds, alert taxonomy, and response playbooks are standardized and continuously improved
• Own CI/CD operational readiness and release governance through Azure DevOps (pipelines/repos/boards), support CAB/RFC execution in Ivanti, and drive secure, repeatable platform changes (patching, certificate/secret rotation, rollback plans, audit evidence)
• Collaborate with Data Ops and FinOps to implement cost/stability guardrails (tagging/limits, capacity controls, policy-as-code) and to reduce operational toil through automation and self-service patterns.
• Monitor Azure Databricks usage and implement cost‐optimization strategies, including:
  • Cluster right‐sizing
  • Autoscaling and auto‐termination
  • Instance pool configuration

Must skills

• Azure Data Engineer
• Azure, Entra ID, ADLS
• Azure Data Factory, GEN2