Senior Azure Data Engineer

About

Elevate your career as a Senior Azure Data Engineer specializing in ETL/ELT processes using Azure Databricks. This role requires a strong focus on building and maintaining high-volume, fault-tolerant data pipelines.

You will take charge of leading architectural decisions while developing optimized pipelines for both batch and streaming data. This position values your expertise in data modeling and big data processing, ensuring operational excellence and high data quality. Foster collaboration with data scientists and analysts to drive data-driven insights and machine learning workloads.

Key Responsibilities:

• Develop and maintain ETL/ELT pipelines with Azure Databricks
• Architect ingestion pipelines for various data types
• Optimize performance of Spark workloads
• Monitor pipeline health and troubleshoot issues
• Mentor team members and promote skill development

Requirements:

• 7+ years of data engineering experience
• Hands-on with Azure Databricks and Delta Lake
• Advanced proficiency in Python and PySpark
• Strong Azure Data Factory skills
• Excellent communication and collaboration abilities

Utilize your data engineering prowess to create efficient data solutions and mentor junior engineers effectively.