Data Engineer Microsoft Purview -- DWIDC5479958

Key Responsibilities

• Purview Implementation: Set up and manage Microsoft Purview for data discovery, cataloging, classification, and sensitivity labeling.
• Data Lineage & Governance: Integrate Purview with Azure data sources (Azure Data Factory, Data Lake, Synapse) to map and manage end-to-end data lineage.
• Compliance & Security: Configure data policies, security standards, and automated governance workflows (Purview Workflow).
• Data Integration: Build scalable ETL/ELT pipelines using Azure Data Factory, Databricks, and Python to move and transform data.
• Monitoring & Optimization: Monitor Purview performance, troubleshoot issues, and optimize data governance initiatives.
• Collaboration: Work with data architects and stakeholders to implement data quality initiatives and provide technical documentation.

Required Skills and Qualifications

• Technical Expertise: Strong knowledge of Microsoft Purview and Azure data services (ADLS Gen2, Synapse, Databricks, SQL Database).
• Data Governance: Experience with data classification, metadata management, and compliance frameworks.
• Languages & Tools: Proficiency in Python, SQL, and data transformation techniques.
• Experience: Usually requires 3-8 years in data engineering with a focus on governance.
• Methodology: Familiarity with Agile development and CI/CD tools