Data Engineer

About

We are seeking a Data Engineer with strong experience in AWS-native data services and Informatica to design, build, and optimize scalable data pipelines. The role involves working with large, structured and semi-structured datasets to support analytics, reporting, and downstream business intelligence platforms in a regulated enterprise environment.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines using AWS Glue and Informatica (PowerCenter / IDMC / IICS)
• Build and optimize analytical datasets using Amazon Redshift
• Enable data exploration and ad-hoc analysis using Amazon Athena
• Ingest data from multiple sources (RDBMS, files, APIs, cloud storage) into AWS data platforms
• Ensure data quality, data validation, and reconciliation across ingestion and transformation layers
• Implement partitioning, indexing, compression, and performance tuning strategies for Redshift and Athena
• Work with structured formats (CSV, JSON, Parquet, Avro) in Amazon S3
• Collaborate with BI, analytics, and data science teams to deliver curated datasets
• Implement logging, monitoring, and error handling for data pipelines
• Adhere to security, governance, and compliance standards (PII, encryption, IAM, auditability)
• Support production issues, root cause analysis, and continuous optimization

Required Skills & Qualifications

Core Technical Skills

• Strong hands-on experience with AWS Glue (ETL Jobs, Crawlers, Data Catalog)
• Experience using Amazon Athena for querying large datasets in S3
• Solid experience with Amazon Redshift (schema design, performance tuning, WLM, distribution styles)
• Strong experience with Informatica (PowerCenter or Intelligent Data Management Cloud – IICS)
• Proficiency in SQL (complex joins, window functions, optimization)
• Hands-on experience with Python or Spark (PySpark)
• Strong understanding of data warehousing concepts (fact/dimension modeling, star/snowflake schema)

Cloud & Data Ecosystem

• Experience with Amazon S3, IAM, CloudWatch
• Understanding of data lake and lakehouse architectures
• Experience working with batch and near-real-time data processing
• Familiarity with CI/CD pipelines for data workflows

Preferred / Nice-to-Have Skills

• Experience in banking, financial services, or insurance domains
• Exposure to AWS Step Functions, Lambda, EMR
• Knowledge of data governance, metadata management, and lineage
• Experience with Informatica Cloud (IDMC) advanced services
• Familiarity with Agile / Scrum delivery models
• Exposure to regulatory and compliance-driven data environments