Senior Data Security & Databricks Architect

About

We are seeking an experienced Senior Data Security & Databricks Architect with over 10 years of expertise in data engineering, data governance, and platform security. This role focuses on designing and implementing secure, scalable data solutions within the Databricks Lakehouse ecosystem, with a strong emphasis on PHI/PII protection, data classification, and AI-enabled data access.

Key Qualification Requirements

• 10+ years of experience in data engineering, data architecture, or data security roles.
• Strong hands-on experience with Databricks Lakehouse platform.
• Proven expertise in PHI/PII data handling, data classification, and compliance frameworks.
• Deep knowledge of data security techniques, including:
  • Data masking
  • Encryption
  • Data minimization
• Experience working with modern table formats:
  • Delta Lake
  • Apache Iceberg
• Interoperable data architectures
• Strong understanding of cloud platforms, especially Microsoft Azure.
• Experience integrating Databricks with Snowflake or similar data platforms.
• Hands-on experience building data dashboards and monitoring frameworks within Databricks.
• Expertise in RBAC implementation and access control frameworks.
• Experience with AI/ML integrations and enabling self-service analytics platforms.
• Proficiency in Python, SQL, and Spark (PySpark/Scala).
• Experience building scalable data applications and APIs within Databricks.
• Strong knowledge of performance optimization techniques, including caching and query tuning.