Lead Data Engineer – IoT, AI & Azure Data Platform

Job Description:

Lead the design, build, and optimization of a scalable Azure-based data platform that transforms high-volume device data into actionable insights and AI-ready datasets.

Day-to-Day Responsibilities:

• Design and build scalable data pipelines for high-volume device and telemetry data
• Develop and manage ETL/ELT workflows using Azure Data Factory and Fabric
• Process both real-time streaming and batch data workloads
• Structure and clean data for reporting, analytics, and AI/ML use cases
• Integrate data with back-office systems (ERP, CRM, etc.)
• Support AI/ML teams by preparing feature-ready datasets
• Optimize performance, scalability, and reliability of data systems
• Lead architecture decisions and mentor engineers/external resources

Requirements:

• Must-Haves:
• 5–8 years of data engineering or data platform experience
• Strong hands-on experience with Azure Data Factory and Microsoft Fabric
• Proven ability to build and scale data pipelines and cloud data platforms
• Experience handling large-scale, high-volume data and structuring it for reporting
• Proficiency in SQL and Python
• Experience with real-time/streaming and batch data processing
• Experience integrating data with enterprise systems (ERP, CRM, etc.)
• Nice-to-Haves:
• Experience with IoT or telemetry data
• Exposure to AI/ML pipelines and data preparation
• Knowledge of JavaScript/TypeScript
• Background in finance, retail, or other high-volume data environments