Senior Data Engineer (Databricks experience is a must)
Dawninfotek
About the role
About
Dawn InfoTek Inc. is a professional IT consulting firm that partners with major financial institutions, investment firms, and government organizations. We are dedicated to delivering cutting‑edge consulting services and recruiting top IT talent across all levels for our clients.
Position
Senior Data Engineer – joining a dynamic development team supporting one of our major financial clients.
Contract Details
- Duration: 6 months with possibility of extension
Location
- Hybrid – 2‑3 days in office required (Downtown, Toronto)
Role Overview
The successful candidate will have an opportunity to be involved in designing and implementing data solutions using Google Cloud, working closely with the enterprise teams, architects, business analysts, and data engineers. To join our team, you must be proactive and dynamic, demonstrate initiative, have an eagerness to learn, be adaptable to a high‑paced environment, and thrive on challenge.
Typical Day / Responsibilities
- Build distributed, reliable and scalable data pipelines to ingest and process data from/to multiple data sources
- Take a lead in designing and building production data pipelines from data ingestion to consumption using GCP services, PySpark, Python, BigQuery
- Create deployment scripts and promote changes to different environments using Terraform
- Support Vertex AI/Kuberflow skill to create AI model pipelines to orchestrate different ELT tasks, AI model creation tasks (ie training, tuning, prediction), and support model team development in Vertex AI configuration such as (feature store, model registry, etc)
- Composer DAG/Airflow development skills to orchestrate different ELT tasks and AI model creation tasks (ie training, tuning, prediction)
- Databricks experience to provide recommendations or guideline for code development that could work on the platform for future migration
- Provide guidance/troubleshooting on implementing application logging, notification, jobs monitoring and performance monitoring
- Understanding of AI model development & deployment concepts
Requirements / Must‑Have Skills
- 5+ years of experience as a Data Engineer in a challenging IT system solution environment with strong communication and problem‑solving skills
- Experience in managing and operations of large‑scale data systems and applications (5+ years)
- Databricks experience is a must
- Experience in automation of large‑scale systems and applications (5+ years)
- Nice to have: Fi/Baking/AML experience, Google IAM, API Concepts, Agile and DevOps team experience
Education
- Bachelor of Computer Science or Information Systems preferred.
Skills
Don't send a generic resume
Paste this job description into Mimi and get a resume tailored to exactly what the hiring team is looking for.
Get started free