Skip to content
mimi

DATA ENGINEER - JOHANNESBURG

Affirmative Portfolios - Durban

On-site Full-time Senior $1000k – $1000k/yr 1w ago

About the role

About

Reporting to the Data Engineer Practice Manager, your key focus areas will be to design and support the delivery of engineering solutions in the data warehouse, balancing the enhancement of ETL processes and modelling while supporting short-term data and reporting requirements from across the business. You will work collaboratively with cross-functional teams within Hollard, including the Infrastructure DevOps team, solution architects, subject matter experts, data modelers, finance, underwriting, operations, etc. This collaboration aims to ensure that Hollard’s data platform ecosystem is optimal in supporting business needs. Additionally, you will work collaboratively with vendors and partners to ensure that data engineering delivery and practices meet Hollard’s standards.

Responsibilities

  • Maintain, support, and monitor existing production SSIS packages and SQL Queries and Stored Procedures, CICD pipelines to make sure all data loads on the data warehouse meet data quality standards and business SLA requirements.
  • Build, maintain, support, and monitor Synapse data engineering pipelines on the data platform if required.
  • Participate and contribute to data architecture design, data modelling, gathering and analysis of data requirements; understand, document, communicate, and build appropriate solutions.
  • Participate, design, build, deliver, and document data-related projects with various environment-specific data analytics technologies.
  • Promote data engineering best practices with CICD pipelines and automation.
  • Collaborate and work closely with team members and contribute significantly to building a high-performing, collaborative, transparent, and result-driven data engineering team.
  • Support the Data Engineering Practice Team Manager with best fit-to-purpose data engineering solutions, quality engineering artifacts, and high-standard documentation.
  • Follow Data Ethics standards to protect personal information and do the right thing to meet our customers’, partners’, and community’s expectations.

Requirements

  • 8+ years of demonstrable experience in the design, build, and support of data engineering pipelines in data warehousing, data ingestion, cleansing, manipulation, modelling, and reporting.
  • Experience in ETL using Microsoft technologies.
  • Strong experience in writing MS SQL server queries, stored procedures, and SSIS Packages.
  • Experience with SSRS would be an advantage.
  • Experience manipulating semi-structured data (XML, JSON).
  • Strong knowledge and extensive experience working in an Agile framework with CI/CD using modern DevOps / Data Ops integrated processes with YAML pipelines.
  • Bachelor’s degree in computer/data science, technical, or a related field is a must.
  • Post-graduate degree is highly regarded.
  • Knowledge of Azure Synapse data engineering pipelines, PySpark notebooks, data platform lake house architecture, and Azure SQL ODS storage is desirable.

Package & Remuneration

  • 1 Million per annum

Requirements

  • 8+ year demonstrable experience in design, build and support of data engineering pipelines in the data warehousing, data ingestion, cleansing, manipulation, modelling and Reporting.
  • Experience in ETL using Microsoft technologies.
  • Strong experience in writing MS SQL server queries, stored procedures, and SSIS Packages.
  • Experience of manipulating semi-structured data (XML, JSON)
  • Strong knowledge and extensive experience in working in an Agile framework with CI/CD using modern DevOps / Data Ops integrated processes with YAML pipelines.
  • Bachelor’s degree in computer/data science technical or related field is a must.

Responsibilities

  • Maintain, support, and monitor existing production SSIS packages and SQL Queries and Stored Procedures, CICD pipelines to make sure all data loads on data warehouse meet data quality standards and business SLA requirements.
  • Build, maintain, support, and monitor Synapse data engineering pipelines on data platform if required.
  • Participate and contribute to data architecture design, data modelling, gathering and analysis of data requirements; understand document, communicate, and build appropriate solutions.
  • Participate, design, build, deliver, and document data related projects with various environment specific data analytics technologies.
  • Promote data engineering best practices with CICD pipelines and automation.
  • Collaborate and work closely with team members and contribute significantly to building a high performing, collaborative, transparent, and result-driven data engineering team.
  • Support the Data Engineering Practice Team Manager with best fit-to-purpose data engineering solutions, quality engineering artifacts and high standard documentation.
  • Follow Data Ethics standards to protect personal information and do the right thing to meet our customers’, partners’, and community’s expectations.

Skills

Azure SQLAzure SynapseCI/CDData EngineeringData LakehouseData ModelingData WarehousingDevOpsETLJSONMS SQLMS SQL ServerPySparkSSISSSRSSQLStored ProceduresXMLYAML

Don't send a generic resume

Paste this job description into Mimi and get a resume tailored to exactly what the hiring team is looking for.

Get started free