Senior DataOps / Cloud Data Engineer

About

Our Client is currently hiring a Senior DataOps / Cloud Data Engineer for a long term public sector engagement

The ideal candidate will have strong experience building cloud based data pipelines, modern lakehouse architectures, ETL frameworks, and enterprise scale data transformation solutions.

Key Responsibilities

• Design, develop, test, implement, and troubleshoot enterprise data pipelines
• Build scalable ETL/ELT workflows using cloud native technologies
• Develop complex data transformation logic and orchestration processes
• Design data warehouse and lakehouse models for analytics and reporting
• Work with structured and unstructured datasets across cloud environments
• Support full SDLC including requirements gathering, deployment, testing, and production support
• Collaborate with cross functional teams in agile delivery environments

Required Technical Skills

• Python, SQL, Linux Shell, PowerShell
• pandas and PySpark
• AWS Glue, Lambda, Step Functions, S3
• Databricks and Delta Lake
• Azure Data Factory
• Informatica IDMC
• AWS and/or Azure cloud services
• Redshift and cloud data warehouse solutions
• Relational and dimensional data modeling
• Data warehouse and lakehouse architecture

Additional Skills

• Agile/Scrum and Waterfall delivery experience
• Change and Incident Management
• Strong communication and stakeholder management skills
• Consulting, analytical, and problem solving capabilities

Must Have Experience

• Data engineering using pandas and PySpark
• Databricks and Delta Lake
• AWS Services: Glue, Lambda, Step Functions, S3
• Informatica IDMC
• Handling XLSX, CSV, JSON, relational databases, cloud storage
• Building ETL pipelines and orchestration workflows