AI
AZURE DATABRICKS ARCHITECT
Atlantis IT group
Toronto · On-site Full-time Lead 6d ago
About the role
Azure Databricks Architect
Responsibilities
- Work independently with business and technical stakeholders and understands the organization's obstacles, and further provides due diligence.
- Build strategy towards optimal solution for the platform and tools.
Requirements
- 10+ years of experience as Azure Databricks architect
- Extensive experience with Azure Data factory, Databricks and Pyspark based data processing.
- Strong understanding of ETL processes, data lakes and data pipeline architecture
- Knowledge of Azure services, Data Modelling, ADLS, Delta Lake, Informatica
- Proficiency in migration from Oracle Exadata to Azure cloud.
- Experience in Pyspark optimization and performance tuning.
- Work independently with business and technical stakeholders and understands the organization's obstacles, and further provides due diligence.
- Build strategy towards optimal solution for the platform and tools.
- 15+ years of experience as Azure Data Solution architect
- Excellent knowledge in architecting/designing/implementation and Migration.
- Experience in Azure Data Modelling, Data pipeline, Azure Data factory, Informatica, Pyspark, Databricks, ETL, ADLS, Delta Lake, Control-M
Good to have skills
- Knowledge of Goldengate
- Knowledge of Control-M
Skills
ADLSAzure Data FactoryAzure DatabricksControl-MDelta LakeETLGoldengateInformaticaOracle ExadataPysparkData Modelling
Don't send a generic resume
Paste this job description into Mimi and get a resume tailored to exactly what the hiring team is looking for.
Get started free