O
Data Engineer (Senior) 0641
Opensource
South Africa · On-site Full-time Senior 1mo ago
About the role
Essential Skills
- Proven experience building and optimizing data pipelines and big data solutions
- Strong programming skills in Python (or similar)
- Experience with cloud data platforms (Azure, AWS, or GCP)
- Solid understanding of data governance, quality, and compliance
- Hands-on experience with CI/CD and workflow orchestration tools
- Strong analytical, problem-solving, and strategic thinking skills
- Ability to lead, collaborate, and influence in cross-functional teams
Role & Responsibilities
- Design, develop, and deliver scalable data engineering solutions using Python or similar languages
- Build and optimize data pipelines and data models using modern frameworks (e.g., Spark, Flink)
- Collaborate with stakeholders to clarify requirements and refine user stories
- Participate actively in Agile ceremonies (planning, refinement, retrospectives)
- Implement CI/CD pipelines and DevOps practices for data workflows
- Ensure data quality, governance, lineage, and compliance across systems
- Provide support and maintenance of existing data solutions
- Drive continuous improvement, innovation, and solution prototyping
- Lead knowledge sharing, mentoring, and coaching within the team
Advantageous Skills
- Experience with streaming platforms (Kafka, RabbitMQ, MQTT)
- Exposure to serverless architectures and cloud-native services
- Familiarity with monitoring and logging tools (Splunk, ELK, Azure Data Explorer)
- Basic frontend knowledge (React, Vue.js)
- Experience supporting production environments and ticket management
- Strong business acumen and ability to translate requirements into solutions
- Experience working in distributed/global teams
- Agile methodology and ITIL knowledge
- Willingness to travel internationally when required
Qualifications
- Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or related field
- Minimum 5+ years’ experience in data engineering within complex environments
- Proven experience delivering cloud-based data solutions
- Relevant cloud certifications are advantageous but not required
Skills
AzureCI/CDELKFlinkGCPKafkaMQTTPythonRabbitMQSpark
Don't send a generic resume
Paste this job description into Mimi and get a resume tailored to exactly what the hiring team is looking for.
Get started free