Senior Data Engineer, Machine Learning & Data Platforms

About the Role

Join a transformative project as a Senior Data Engineer focused on Machine Learning and Data Platforms, with the flexibility to work remotely in Toronto, Ottawa, or Montreal. Build robust data pipelines for complex automotive datasets to derive actionable insights. Our client is seeking an experienced Data Engineer to thrive in a large-scale machine learning environment. This remote role focuses on designing and maintaining scalable data foundations to support advanced analytics by collaborating with a diverse team. You will meticulously handle messy datasets, ensuring data quality, governance, and reliability.

Responsibilities

• Design and maintain scalable data pipelines for diverse datasets
• Optimize Spark-based workflows supporting production machine learning systems
• Collaborate with data scientists and business stakeholders
• Translate business needs into production-ready data solutions
• Build feature engineering pipelines for predictive models

Requirements

• 6+ years of experience in data engineering or machine learning data pipelines
• Proficiency with Apache Spark, PySpark, and Databricks
• Expertise in Python, SQL, and Airflow
• Understanding of Medallion architecture and ETL patterns
• Bachelor's or Master's degree in Computer Science or a related field

About the Future

Support the future of industrial intelligence through data-driven solutions.