Senior Data Engineer (Risk & Analytics Platform)

We are seeking an experienced Data Engineer to design, build, and maintain large-scale data platforms supporting risk analytics and business-critical systems. This role involves working with high-volume data, real-time streaming pipelines, and cloud-native technologies in a production environment.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines for batch and real-time processing
• Build and optimize data workflows using Python, Scala, and Apache Spark
• Develop and manage data solutions on cloud platforms (Azure and/or GCP)
• Deploy and manage containerized applications using Kubernetes
• Work with structured and unstructured data across relational and NoSQL databases
• Write, optimize, and maintain complex SQL queries and scripts
• Collaborate with cross-functional teams in an Agile environment
• Implement best practices including Test-Driven Development (TDD) and code quality standards
• Support data integration across multiple systems and services

Required Qualifications

• 4+ Years of experience building and maintaining large-scale production applications
• Strong programming skills in Python and/or Scala
• Hands-on experience with Apache Spark (batch and streaming)
• Solid experience with SQL and database technologies (relational and NoSQL)
• Experience with cloud platforms such as Azure or GCP
• Familiarity with Kubernetes and containerized deployments
• Experience with Databricks or similar big data platforms
• Understanding of Agile methodologies and TDD practices
• Bachelor’s Degree in Computer Science, Engineering, or equivalent experience

Nice to Have

• Experience in financial services or risk analytics platforms
• Exposure to real-time data streaming technologies (e.g., Kafka)
• Understanding of data security and governance practices