Senior Data Engineer

About

Be at the forefront of data engineering by migrating Databricks to a tailored AWS environment. This role actively involves building data pipelines while ensuring the utmost integrity and consistency in data handling.

As a Senior Data Engineer, your hands-on experience will guide the transition using Terraform and Databricks Assets. You'll optimize data workflows using Spark in either Python or Scala and configure orchestration workflows seamlessly. Collaboration with infrastructure teams is key to maintaining security and performance.

Key Responsibilities

• Facilitate the migration of Databricks environments to AWS
• Develop infrastructure-as-code via Terraform
• Create and manage CI/CD pipelines using Git Hub Actions
• Optimize Spark jobs for data processing
• Configure Unity Catalog objects for access management

Requirements

• 5+ years in data engineering experience
• Proficient with Databricks on AWS services
• Solid skills in Terraform for infrastructure management
• Familiar with CI/CD practices
• Knowledge of data lake architectures

Contribute your expertise to transform our data practices and strengthen our cloud capabilities.