Cloud Data Engineer

Key Responsibilities

• Design, implement, and maintain data infrastructure on cloud platforms including AWS and Azure

• Build and manage scalable data lakes for structured and unstructured data

• Develop and maintain data pipelines for efficient data ingestion, transformation, and processing

• Integrate multiple data sources into a unified and cohesive data platform

• Work with Azure Kubernetes Service (AKS) for containerized data workloads

• Utilize Python and SQL for data processing, transformation, and automation

• Implement ETL processes using tools such as Apache NiFi, Talend, and AWS Glue

• Work with AWS services including EC2, S3, Redshift, Glue, Athena, Lambda, Kinesis, and EMR

• Manage and optimize SQL and NoSQL databases such as MySQL, PostgreSQL, MongoDB, and Cassandra

• Ensure data quality, performance, and scalability across systems

• Collaborate with cross-functional teams including analytics, DevOps, and application teams

• Maintain documentation for data architecture, pipelines, and workflows