Lead Data Engineer with AI Development

About

We are seeking a highly skilled Lead AWS Data Engineer with strong hands-on experience in building scalable data solutions on AWS. The ideal candidate will have deep expertise in data engineering, cloud technologies, and leading data-driven initiatives.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using AWS services
• Lead end-to-end data engineering solutions from ingestion to transformation and loading
• Work closely with cross-functional teams including Data Scientists, Analysts, and Architects
• Optimize and monitor data workflows for performance, reliability, and cost-efficiency
• Implement data governance, security, and compliance best practices
• Mentor junior engineers and provide technical leadership
• Collaborate with stakeholders to understand business requirements and translate them into technical solutions

Required Skills

• 10+ years of experience in Data Engineering
• Strong hands-on experience with AWS services (S3, Glue, Redshift, Lambda, EMR), Power BI, AI/ML, AI native, AI Devlopement, AI Chatbot
• Proficiency in Python / PySpark / SQL
• Experience with ETL/ELT pipeline development
• Strong knowledge of data warehousing concepts
• Experience with Apache Spark / Hadoop ecosystem
• Familiarity with CI/CD pipelines and DevOps practices
• Excellent problem-solving and communication skills