Lead Data Engineer and ETL Technical Lead

Data Engineer /ETL Lead Sr Technical Lead-Data Engg Area(s) of responsibility

Job Title - Lead Data Engineer / ETL Lead

Key Responsibilities • Lead the design, development, and optimization of end-to-end data pipelines across batch and real-time processing • Architect and implement enterprise-grade ETL solutions using Informatica, Ab Initio, and cloud-native services • Drive large-scale data migration and conversion initiatives, including mock runs, reconciliation, validation, and production cutovers • Design and manage cloud-based data platforms, leveraging Snowflake and AWS analytics services • Build and optimize PySpark-based data processing frameworks for high-volume datasets • Implement real-time data ingestion and transformation pipelines using Kafka and streaming technologies • Own performance tuning, scalability, cost optimization, and SLA adherence for data workloads • Collaborate closely with business, functional, and architecture teams to translate requirements into robust technical solutions • Lead and mentor development teams, conducting code reviews and enforcing engineering best practices • Oversee CI/CD, scheduling, monitoring, and operational stability of data pipelines • Support Agile delivery by participating in planning, backlog grooming, execution, and retrospectives.

Experience Level Senior Level