Spark Scala Developer

Job Summary

Our client is looking for an experienced Spark Scala Developer with strong expertise in Big Data technologies and distributed data processing. The ideal candidate should have hands-on experience in Apache Spark, Scala, Hadoop ecosystem, and enterprise-level data engineering projects within the Banking/Financial Services domain. The candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and high-performance data processing applications for mission-critical banking systems.

Must Have Skills

• Bachelor’s degree in Computer Science, Engineering, or related field
• 8–10+ years of IT experience with strong Big Data development background
• Must have strong hands-on / coding expertise in Scala and Apache Spark
• Strong experience with Hadoop ecosystem (HDFS, Hive, Yarn, MapReduce)
• Experience building scalable ETL/data processing pipelines
• Strong SQL and database knowledge
• Experience with Kafka or other streaming technologies
• Experience working in Banking / Financial Services domain
• Strong understanding of distributed computing concepts
• Experience with cloud platforms such as AWS/Azure/GCP is a plus
• Familiarity with CI/CD pipelines, Git, Jenkins, and Agile methodologies

Key Responsibilities

• Design, develop, and maintain scalable Spark-Scala applications
• Build high-performance batch and real-time data processing pipelines
• Optimize Spark jobs for performance, scalability, and reliability
• Work closely with data architects, business analysts, and downstream teams
• Analyze large datasets and implement data transformation logic
• Integrate data from multiple enterprise systems and APIs
• Troubleshoot production issues and provide timely resolutions
• Participate in code reviews and enforce development best practices
• Ensure compliance with banking security and data governance standards

Nice to Have

• Experience with Databricks
• Exposure to Python/PySpark
• Knowledge of Airflow or workflow orchestration tools
• Understanding of Capital Markets or Risk/Compliance systems
• Experience with containerization tools like Docker/Kubernetes.