Lead Databricks Engineer – Cloud Migration & Lakehouse

Key Responsibilities

• Lead and execute migration of legacy data platforms (on‑prem / non‑standard tools) to Databricks on cloud under the Olympus program
• Perform application, data, and pipeline refactoring to cloud‑native Databricks patterns
• Drive migration planning including dependency analysis, sequencing, and cutover strategy
• Support coexistence models and transition from dual‑run to cloud‑only execution

Databricks Lakehouse Engineering

• Design and implement Databricks Lakehouse architecture
• Build scalable batch and streaming pipelines using PySpark, Spark SQL
• Leverage Delta Lake for reliability, versioning, and performance
• Optimize compute usage and cost in line with enterprise cloud efficiency goals

Required Qualifications

• 8–12+ years in data engineering / platform modernization
• Strong hands‑on experience with Databricks in large‑scale enterprises
• Proven experience delivering cloud migration programs (on‑prem → cloud)
• Deep expertise in Apache Spark, PySpark, Spark SQL
• Experience embedding controls, reconciliation, and data quality in migrations
• Experience in regulated environments (banking / financial services preferred)