Data Engineer

About

Join as a Data Engineer specializing in Apache Spark and proficient in Python, Scala, or Java. Drive the development of high-performance data pipelines within a scalable distributed framework.

This role is critical in creating and maintaining Spark applications on Azure Databricks, focusing on scalable data processing solutions. You'll participate in optimizing performance, debugging job failures, and collaborating with data teams to enhance analytics outcomes.

Key Responsibilities

• Develop and maintain large Spark applications
• Build and optimize batch and streaming pipelines
• Write production-quality code with performance focus
• Debug and troubleshoot Spark job issues
• Collaborate with analytics and engineering teams

Requirements

• Bachelor’s degree or equivalent in a related field
• 3+ years of experience in data engineering
• Strong skills in Apache Spark and programming languages
• SQL expertise for data analysis and transformation
• Familiarity with Git and software engineering principles

Leverage your technical skills to enhance cloud-based analytics solutions through efficient data processing and robust collaboration.