Skip to content
mimi

Data Engineer (Senior) 0641

Opensource

South Africa · On-site Full-time Senior 1mo ago

About the role

Essential Skills

  • Proven experience building and optimizing data pipelines and big data solutions
  • Strong programming skills in Python (or similar)
  • Experience with cloud data platforms (Azure, AWS, or GCP)
  • Solid understanding of data governance, quality, and compliance
  • Hands-on experience with CI/CD and workflow orchestration tools
  • Strong analytical, problem-solving, and strategic thinking skills
  • Ability to lead, collaborate, and influence in cross-functional teams

Role & Responsibilities

  • Design, develop, and deliver scalable data engineering solutions using Python or similar languages
  • Build and optimize data pipelines and data models using modern frameworks (e.g., Spark, Flink)
  • Collaborate with stakeholders to clarify requirements and refine user stories
  • Participate actively in Agile ceremonies (planning, refinement, retrospectives)
  • Implement CI/CD pipelines and DevOps practices for data workflows
  • Ensure data quality, governance, lineage, and compliance across systems
  • Provide support and maintenance of existing data solutions
  • Drive continuous improvement, innovation, and solution prototyping
  • Lead knowledge sharing, mentoring, and coaching within the team

Advantageous Skills

  • Experience with streaming platforms (Kafka, RabbitMQ, MQTT)
  • Exposure to serverless architectures and cloud-native services
  • Familiarity with monitoring and logging tools (Splunk, ELK, Azure Data Explorer)
  • Basic frontend knowledge (React, Vue.js)
  • Experience supporting production environments and ticket management
  • Strong business acumen and ability to translate requirements into solutions
  • Experience working in distributed/global teams
  • Agile methodology and ITIL knowledge
  • Willingness to travel internationally when required

Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or related field
  • Minimum 5+ years’ experience in data engineering within complex environments
  • Proven experience delivering cloud-based data solutions
  • Relevant cloud certifications are advantageous but not required

Skills

AzureCI/CDELKFlinkGCPKafkaMQTTPythonRabbitMQSpark

Don't send a generic resume

Paste this job description into Mimi and get a resume tailored to exactly what the hiring team is looking for.

Get started free