PG
Senior Data & AI Platform Engineer - Azure Data Engineering at paiqo GmbH Remote
paiqo GmbH
Remote · Canada Full-time Senior 2w ago
About the role
About
Senior Data & AI Platform Engineer – Azure Data Engineering – paiqo GmbH (Remote)
As a Senior Data & AI Platform Engineer – Azure Data Engineering, you will lead the architecture and development of modern lakehouse platforms on Azure. Use the latest Azure services such as Microsoft Fabric, Unity Catalog, and Databricks to implement end-to-end data solutions, ensuring governance, scalability, and performance.
Tasks & Responsibilities
- Architecture of data lakehouse solutions using OneLake, Delta Lake, and Fabric, as well as zero-ETL data integration (mirroring)
- Introduction of Databricks Photon and serverless clusters for high-performance processing and implementation of Unity Catalog for fine-grained access control
- Definition and enforcement of standards (IaC, CI/CD, DataOps) and coordination of multiple projects; mentoring of junior engineers
- Development of robust monitoring and data quality frameworks; use of Purview and observability tools
- Advising internal stakeholders on data strategy, governance, and cost efficiency; close coordination with business departments
Requirements
- 5+ years of experience in data engineering / data platform development, including extensive practice on Microsoft Azure
- Knowledge of data architectures, distributed data processing systems and cloud services like Azure Data Factory, MS Fabric, Databricks, Event Hubs are required
- Experience in data security and governance – knows data protection requirements and implements access authorizations, encryption and compliance conformity
- Proven ability to achieve performance and cost optimization with large data volumes
- Proficient in DevOps methods: continuous delivery of data pipelines, infrastructure-as-code (e.g. Terraform/Bicep) and containerized deployments.
- Strategic thinking & consulting: Ability to translate business requirements into data architectures and advise clients.
- Leadership skills to technically lead a team, as well as clear communication skills with customers (including non-technical contacts).
- Language skills: Very good knowledge of German and English.
Work Setup
- A hybrid/remote setup is possible in Austria.
Requirements
- 5+ years of experience in data engineering / data platform development, including extensive practice on Microsoft Azure
- Knowledge of data architectures, distributed data processing systems and cloud services like Azure Data Factory, MS Fabric, Databricks, Event Hubs are required
- Experience in data security and governance - knows data protection requirements and implements access authorizations, encryption and compliance conformity
- Proven ability to achieve performance and cost optimization with large data volumes
- Proficient in DevOps methods: continuous delivery of data pipelines, infrastructure-as-code (e.g. Terraform/Bicep) and containerized deployments.
- Strategic thinking & consulting: Ability to translate business requirements into data architectures and advise clients.
- Leadership skills to technically lead a team, as well as clear communication skills with customers (including non-technical contacts).
- Very good knowledge of German and English.
Responsibilities
- Architecture of data lakehouse solutions using OneLake, Delta Lake, and Fabric, as well as zero-ETL data integration (mirroring)
- Introduction of Databricks Photon and serverless clusters for high-performance processing and implementation of Unity Catalog for fine-grained access control
- Definition and enforcement of standards (IaC, CI/CD, DataOps) and coordination of multiple projects; mentoring of junior engineers
- Development of robust monitoring and data quality frameworks; use of Purview and observability tools
- Advising internal stakeholders on data strategy, governance, and cost efficiency; close coordination with business departments
Skills
AzureAzure Data FactoryBicepCI/CDDatabricksDataOpsDelta LakeEvent HubsIaCMicrosoft FabricMirroringOneLakePhotonPurviewTerraformUnity Catalog
Don't send a generic resume
Paste this job description into Mimi and get a resume tailored to exactly what the hiring team is looking for.
Get started free