GCP Cloud Engineer with Java

Job Description

Fix and enhance Dataflow and/or Dataproc Data ingestion pipelines (batch & Streaming) .

Have Good Understanding of GCP Composer (Apache Airflow) environments.

Manage Airflow DAGs and troubleshoot Airflow-related issues.

Monitor and optimize Composer performance and scalability.

Maintain GCP Infrastructure Including Services Like

• Google Cloud Storage (GCS)
• BigQuery (BQ)
• Cloud Dataflow ( Apache Beam )
• Cloud Dataproc
• Cloud Functions
• Cloud Run

Have Good Understanding Of

• IAM and service account permissions
• Secret Manager

Monitor GCP usage and quotas, and proactively prevent quota-related issues.

Set up and manage alerting, logging, and monitoring using tools like Stackdriver (Cloud Monitoring & Logging).

DB design experience (with Excellent RDBS-PLSQL knowledge )

Design Springboot APIs

Analyze, design, create Dockerfile

Knowledge on Angular ( Good to Have )

Design and implement infrastructure as code using Terraform for provisioning and managing GCP resources.

Collaborate with DevOps and development teams to manage CI/CD pipelines using Jenkins and other automation tools.

Ensure security, compliance, and cost-efficiency across the cloud environment.

Document system configurations, procedures, and best practices.

Proficient in either Java or Python programming languages.

Excellent problem-solving and troubleshooting skills.

Strong communication and documentation abilities.

Knowledge on DNS and SSO configuration setup

Knowledge on CDC Pipelines/Application (Good to Have)