Expert Data Engineer with Databricks

About

Drive data innovation as a Senior Data Engineer at TD in Toronto. Utilize Databricks, Apache Spark, and Python to design cutting-edge data solutions.

This position seeks a seasoned data engineer with over 8 years of experience in Data Engineering. You will be responsible for the design and development of scalable data platforms that integrate data governance and high performance.

Your role is crucial in ensuring reliability and efficiency in data processing workflows and facilitating strategic insights.

Responsibilities

• Maintain comprehensive end-to-end data pipelines using Databricks
• Craft Lakehouse architectures with Delta Lake
• Develop near-real-time processing solutions in Python
• Implement data ingestion frameworks via Azure Data Factory
• Execute performance optimization strategies for Spark

Requirements

• Minimum of 8 years in Data Engineering
• At least 5 years experiencing Databricks and Spark
• Proficiency in Python and SQL essential
• Familiarity with Azure Data Factory and MS SQL Server
• Active Databricks certification compulsory

Bring your expert data engineering skills to TD to create transformative data solutions.