Lead Data Engineer - Remote

Job details: Lead Data Engineer Location: San Francisco, CA/ Remote, USA. Description: We are looking at 8-10 years of software development and deployment experience with at least 7 years of hands-on experience with SQL, Databricks, ADF, Datastage (or other ETL tool), SSAS cubes, Cognos, Tableau, Thoughtspot and other BI tools · Write SQL for processing raw data, kafka ingestions, adf pipelines, data validation and QA · Knowledge working with APIs to collect or ingest data · Experience with advanced SQL and Python · Strong Database knowledge, SQL & No-SQL preferred Other Responsibilities • Data Architecture Design: Responsible for designing the overall data architecture and data modeling strategies for the BI system. They collaborate with stakeholders to understand business requirements and translate them into a robust and scalable data model. Create logical and physical data models using best practices to ensure high data quality and reduced redundancy. • Data Integration: Will work on integrating data from various sources, such as databases warehouses and external systems. They develop strategies for data extraction, transformation, and loading (ETL) processes to ensure data accuracy, consistency, and availability for reporting and analysis. • BI Tool Selection and Implementation: Evaluate and select appropriate BI tools and technologies based on the organization's needs. Run POC and the implementation and configuration of BI software, including data visualization tools, reporting platforms, and analytics solutions. • Performance Optimization: Monitor and optimize the performance of the BI system to ensure efficient data retrieval, processing, and reporting. They identify and resolve performance bottlenecks by tuning queries, optimizing data structures, and implementing caching mechanisms. • Collaboration and Stakeholder Management: Collaborates with business stakeholders, data analysts, developers, and IT teams to understand their requirements and deliver solutions that meet their needs. They communicate complex technical concepts to non-technical stakeholders and provide guidance on leveraging BI capabilities. • Continuous Improvement: They stay updated with the latest trends, technologies, and best practices in the BI field. They explore opportunities for process improvement, automation, and innovation to enhance the organization's data analytics capabilities. • Data Governance and Security: Needs to establish data governance policies and procedures to ensure data quality, consistency, and security. Define access controls, data privacy measures, and data retention policies to comply with regulatory requirements and protect sensitive information. • Lead, design and implement innovative analytical solution using Tableau, SQL, and other Big Data related technologies • Work with product and engineering team to understand requirements, evaluate new features and architecture to help drive decisions • Build collaborative partnerships with architects, technical leads and key individuals within other functional groups • Perform detailed analysis of business problems and technical environments and use this in designing quality technical solution • Actively participate in code review and test solutions to ensure it meets best practice specifications • Build and foster a high-performance engineering culture, mentor team members and provide team with the tools and motivation to make things happen • Work with stakeholders and cross-functional teams to develop new solutions or enhance existing solution • Demonstrate our Sephora values of Passion for Client Service, Innovation, Expertise, Balance, Respect for All, Teamwork, and Initiative We’re excited about you if you have: • 8-10 years Experience building data ingestion pipelines (simulating Extract, Transform, Load workload), data warehouse or database architecture • Experience writing design documentation, Source to Target mapping documentation, manage confluence pages. • Experience in converting business functionalities into technical jira stories • Experience in analyzing huge datasets, identify trends, patterns, and outliers to extract meaningful insights • Strong experience with data modeling, design patterns, building highly scalable Business Intelligence Solutions and distributed applications • Knowledge of cloud platforms, for example: • Experience with Azure, AWS or equivalent cloud platforms • Experience with storing, joining, filtering, and analyzing data using SQL, Spark, Hive etc. • Experience working with continuous integration framework, building regression-able code within data world using GitHub, Jenkins and related applications • Experience with programming/scripting languages such as Scala/Java/Python/R etc. (any combination) • Analytical approach to problem-solving with an ability to work at an abstract level and gain consensus; excellent interpersonal, leadership and communication • Data-oriented personality. Motivated, independent, efficient a