Senior Data Engineer – Enterprise Data Platforms
Next-Link
About the role
We are seeking an experienced Senior Data Engineer<\/b> to design, build, and operate enterprise -scale data pipelines and datasets that support advanced analytics, enterprise reporting, and machine learning use cases. You will play a key role in shaping the Enterprise Data Strategy and Common Data Model while working closely with data scientists, analysts, and business stakeholders in an Agile environment. <\/p> Key Responsibilities <\/h2>
Design, build, and maintain datasets and data pipelines for analytics and data science use cases <\/p><\/li>
Prepare, troubleshoot, and optimize data pipelines to ensure reliability, performance, and data quality <\/p><\/li>
Co -design and evolve the Enterprise Data Strategy<\/b> and Common Data Model<\/b> <\/p><\/li>
Implement and operate core Data Platform processes and services<\/b> <\/p><\/li>
Develop and maintain data pipelines tailored for Data Scientists<\/b> and analytics teams <\/p><\/li>
Maintain and govern model JSON schemas<\/b>, metadata, and data definitions <\/p><\/li>
Identify, analyse, and resolve data quality and data consistency issues <\/p><\/li>
Support: <\/p>
Enterprise reporting and analytics <\/p><\/li>
Machine Learning operations (MLOps) <\/p><\/li><\/ul><\/li>
Collaborate with stakeholders across IT, data science, analytics, and business domains using Agile delivery methods <\/p><\/li><\/ul>
<\/div><\/span> Requirements<\/h3>
Proven experience working with Big Data platforms and technologies<\/b>, including: <\/p>
S3, Hive, Spark, Trino, MinIO <\/p><\/li>
Kubernetes (K8S) and Kafka <\/p><\/li><\/ul><\/li>
Strong experience with SQL -based and relational data systems<\/b>, including PL/SQL <\/p><\/li>
Experience handling banking or financial data<\/b>, including governance and regulatory considerations <\/p><\/li>
Hands -on experience with large -scale on -premises Data Lake migrations<\/b> <\/p><\/li>
Integration of Data Science workbenches such as: <\/p>
KNIME, Cloudera, Dataiku (or similar platforms) <\/p><\/li><\/ul><\/li>
Experience working in Agile environments<\/b> (Scrum, SAFe) <\/p><\/li>
Proven stakeholder management and cross -team collaboration skills <\/p><\/li><\/ul> Technical Skills <\/h2>
Strong understanding of enterprise data reference architectures<\/b> <\/p><\/li>
Expert -level SQL<\/b> and data modelling skills <\/p><\/li>
Python for: <\/p>
Automation <\/p><\/li>
Data processing <\/p><\/li>
Notebooks and analytics workflows <\/p><\/li><\/ul><\/li>
Data preparation techniques for: <\/p>
Reporting <\/p><\/li>
Advanced analytics <\/p><\/li>
Machine learning <\/p><\/li><\/ul><\/li>
Experience implementing and working with data quality frameworks<\/b> <\/p><\/li>
Familiarity with streaming and event -driven architectures using Kafka <\/p><\/li><\/ul>
<\/div><\/span>
Requirements
- Proven experience working with Big Data platforms and technologies
- Strong experience with SQL-based and relational data systems
- Experience handling banking or financial data
- Hands-on experience with large-scale on-premises Data Lake migrations
- Experience working in Agile environments
- Proven stakeholder management and cross-team collaboration skills
Responsibilities
- Design, build, and maintain datasets and data pipelines for analytics and data science use cases
- Prepare, troubleshoot, and optimize data pipelines to ensure reliability, performance, and data quality
- Co-design and evolve the Enterprise Data Strategy and Common Data Model
- Implement and operate core Data Platform processes and services
- Develop and maintain data pipelines tailored for Data Scientists and analytics teams
- Maintain and govern model JSON schemas, metadata, and data definitions
- Identify, analyse, and resolve data quality and data consistency issues
- Support enterprise reporting and analytics
- Support Machine Learning operations (MLOps)
- Collaborate with stakeholders across IT, data science, analytics, and business domains using Agile delivery methods
Skills
Don't send a generic resume
Paste this job description into Mimi and get a resume tailored to exactly what the hiring team is looking for.
Get started free