Senior Data Engineer

About

Lead data engineering initiatives with expertise in Spark SQL and dimensional modeling. Focus on implementing efficient ETL pipelines and optimizing analytical queries for enterprise reporting.

As a Senior Data Engineer, you will leverage your experience with Slowly Changing Dimensions and have a strong command of window functions. This role demands collaboration with cross-functional teams to translate business requirements into actionable data models while ensuring optimal performance.

Key Responsibilities

• Create advanced data models for analytics
• Implement ETL pipelines using Azure Databricks
• Perform query optimization for Spark SQL
• Collaborate with stakeholders for requirement gathering
• Address performance issues and propose solutions

Requirements

• 5-8 years in data engineering roles
• Proficient in Spark SQL and Py Spark
• Strong understanding of dimensional models
• Experience with Delta Lake operations
• Excellent communication and teamwork abilities

Harness your technical expertise to drive impactful data solutions and enhance reporting capabilities across teams.