Data Enginner

Job Description

• To develop, construct, test and maintain data pipelines architectures.
• To ensure interoperability of systems by designing and maintaining integration patterns (APIs, etc.), data exchange formats, and integration protocols.
• To design and build data pipelines that are robust, modular, scalable, deployable, reproducible and versioned for data domains and business domains.
• To quality assure data pipelines implementations to ensure adherence to data engineering frameworks and standards.
• To recommend ways to improve data reliability, efficiency, and quality.
• To monitor and optimise domain-specific data pipelines to ensure reliable data availability and sustained performance over time.
• To develop and manage stakeholder relations effectively to promote data management across the organisation and support reliable decision making and appropriate data usage.
• To maintain documentation for data pipelines, integration processes, and interoperability.
• To manage data growth patterns to plan infrastructure needs, ensure compliance with retention frameworks, and support responsible data sharing.
• To enable and support the technical implementation of data management capabilities, including, data quality, metadata management, master and reference data management, data architecture and data modelling, data security and privacy, data lifecycle and retention management, data cataloguing and lineage, and analytics enablement.