AI-Driven Data Engineer

About

Be at the forefront of innovation as an AI-Driven Data Engineer, utilizing Python and big data technologies to create robust data solutions in Canada. Your expertise will significantly influence data strategies. A key member of our data engineering squad, you will leverage 4+ years of experience to tackle complex challenges. Collaborate closely with diverse teams to develop advanced data models, ensuring optimal performance and compliance in data management while utilizing cutting-edge AI coding tools.

Key Responsibilities

• Build resilient data processing and transformation pipelines
• Design scalable data storage solutions using big data technologies
• Collaborate with business stakeholders to refine data requirements
• Implement real-time data streaming architectures with Kafka
• Support continuous improvement initiatives using AI tools

Requirements

• 4+ years of experience as a Data Engineer
• Mastery of Python and experience with PySpark
• Extensive understanding of distributed databases and Apache Spark
• Proficiency with cloud services (AWS/Azure/GCP)
• Competence in API development and integration

Leverage your technical skills and AI mindset while making impactful contributions to data initiatives.