Azure Databricks Architect

About

Dice is the leading career destination for tech experts at every stage of their careers. Our client, Happiest Minds Technologies Limited, is seeking the following.

Key Responsibilities

• Lead customer discussion, architecture design and implementation for large scale modern data platform implementations.
• Lead the setup and evolution of DataOps processes: CI/CD pipelines, observability, automation, testing, lineage, and monitoring.
• Define intake, triage, escalation, and support workflows from scratch to support BAU operations.
• Work with global teams (support, platform, and data engineering) to ensure smooth handoffs and delivery of tasks.
• Create frameworks, runbooks, and reusable modules to enable fast onboarding and continuous delivery.
• Act as a thought partner to leadership on platform scalability, data governance, and modernization.
• Work closely with offshore SMEs to help position Happiest Minds offering.
• Mentor engineers and support teams on architectural best practices, performance tuning, and operational excellence.
• Participate in architecture reviews, vendor/tool evaluations, and innovation initiatives.

Skills & Experience

• 15+ years in data architecture and engineering roles.
• Strong knowledge of Modern Data Platform, DataOps, MLOps, and AIOps principles and tooling.
• Deep hands-on experience with Databricks (Delta Lake, notebooks, workflow, Unity Catalog).
• Proficiency in Python, SQL, PySpark, and REST APIs.
• Proven experience with Azure services such as ADF, Stored Procedures, Purview, Azure DevOps etc.
• Knowledge and hands of experience with downstream like Business Intelligence (Power BI, Tableau), AI/ML and GenAI.
• Experience with enterprise data governance (catalogues, access control, lineage).
• Strong understanding of support models and SLAs in enterprise environments.

Preferred Qualifications

• Certifications in Azure and Databricks
• Experience working in regulated industry, Energy and Utility.