Platform Engineer

Summary

We are seeking an experienced Platform Engineer who will be part of the Platform team managing the Data Science platform.

Job Responsibilities

• Support ongoing Data Science Infrastructure operations.
• Develop and deploy AWS environments using CI/CD processes for a rapidly growing team of Data Scientists.
• Manage and support large-scale environments to meet the needs of current and future Data Science teams.
• Champion and mature the environment by implementing and overseeing the image management lifecycle process.
• Assist in setting up and managing AWS accounts specifically for the Data Science platform.
• Provide hands-on development using CI/CD tools such as Azure DevOps.
• Utilize Infrastructure as Code (IaC) tools such as Terraform for environment setup and management.
• Develop scripts and applications using programming languages such as Python.
• Manage database technologies including Athena, Oracle, MySQL, and Postgres.
• Leverage AWS services essential for Data Lake, Data Science, AI/ML teams.
• Handle and resolve requests from development and business users, addressing any roadblocks.
• Manage secured infrastructure, enforce security measures, and apply necessary guard rails.
• Resolve infrastructure vulnerabilities within SLAs and maintain audit logs.
• Perform system upgrades and patching, providing on-call support as needed.
• Conduct root cause analysis and knowledge transfer sessions with the internal team.
• Collaborate with Network, Database, Infrastructure, and Architecture teams to align on projects and strategies.

Basic Qualifications

• Bachelor’s degree in computer science or a related field.
• 2+ years experience in Data Science Infrastructure.
• 2+ years extensive experience with Data Lake, Data Science, and AI/ML services hosted on AWS infrastructure.
• 2+ years working knowledge of the following technologies:
  • Kubernetes
  • AWS services such as SageMaker, Glue, Lambda, Athena
  • CI/CD tools like Azure DevOps
  • IaC tools like Terraform
  • Docker and ECR (Elastic Container Registry)
  • Security tools like AQUA and Kenna
• 2+ years experience in technical write-ups.
• AWS and Terraform certified professionals. Kubernetes or CKA
• Familiarity with technical service management and product life cycle maintenance.
• Knowledge of programming and scripting languages such as Python and shell scripting.
• In-depth knowledge of database technologies like Athena, Oracle, MySQL.
• Extensive experience with CI/CD and IaC tools such as Azure DevOps and Terraform