Lead Data Engineer

Join Sedgwick to play a meaningful role in supporting individuals around the globe who are navigating unexpected challenges. As part of our team of 33,000 colleagues, you'll have the opportunity to grow your career while enjoying a supportive work-life balance. Here, your potential is limitless!

Recognized by Newsweek as one of America's Greatest Workplaces and certified as a Great Place to Work®, we take pride in our workplace culture. Additionally, we have been recognized among Fortune's Best Workplaces in Financial Services & Insurance.

Role Overview

As a Lead Data Engineer in the Transformation Office, you will architect and manage the data supply chain for advanced projects. Your focus will be on building pipelines that connect legacy on-prem systems (Mainframes, SQL Server, DB2) with our modern Snowflake environment and AI stacks on AWS and Azure. You're a proactive builder who engineers data specifically for model training, feature stores, and RAG-based AI systems.

Key Responsibilities

• Hybrid Data Pipeline Execution: Design and implement ETL/ELT pipelines to gather data from legacy on-prem sources, AWS (S3/RDS), and Azure (Blob/SQL), centralizing it for use in Snowflake and AI services.
• Engineering for Data Science: Build and maintain Feature Stores and specialized datasets optimized for machine learning to ensure Data Scientists can access clean, versioned, and statistically valid data swiftly.
• Engineering for AI (RAG & LLMs): Develop pipelines for Generative AI, including automated extraction and loading of unstructured data into vector stores across AWS and Azure.
• Snowflake Expertise: Serve as the technical lead for our Snowflake data warehouse, focusing on data modeling, Snowpipe automation, and compute optimization for AI workloads.
• Legacy Data Engineering: Utilize non-invasive extraction methods to access critical data from older on-prem systems while maintaining uninterrupted business operations.
• Multi-Cloud Orchestration: Oversee complex data workflows across multiple platforms using Airflow, Step Functions, or Azure Data Factory.
• IT & Security Collaboration: Work directly with IT, Database Administrators, and Security teams to address connectivity obstacles and secure new data flow projects.
• Data Quality Assurance: Implement automatic validation and observability to identify data drift and ensure the integrity of AI and Data Science models.
• Cost & Performance Oversight: Drive efficiency in our data stack by optimizing performance and storage costs in Snowflake, AWS, and Azure.
• Stakeholder Collaboration: Act as a dedicated partner to MLOps and Data Science teams to swiftly adapt to evolving AI data requirements.

Qualifications

• Education: Bachelor's in Computer Science, Data Engineering, or a related field required; Master’s degree preferred.
• Experience: 6+ years in data engineering with a proven record in building production-grade pipelines for Data Science and AI in multi-cloud environments.
• Snowflake Mastery: Expert-level skills in Snowflake, including data sharing and performance tuning.
• Multi-Cloud Expertise: Thorough knowledge of AWS (S3, Glue, Lambda) and Azure (Data Factory, Synapse).
• Technical Skills: Proficient in Python, SQL, and PySpark. Extensive experience with data orchestration and containerization (Docker).
• Legacy Systems: Ability to work with on-prem SQL, Mainframe extracts, and flat files while transforming data for modern cloud use.
• AI/Data Science Knowledge: Strong understanding of the data requirements for Machine Learning and Generative AI.
• Execution Focus: A results-oriented mindset to drive solutions in a dynamic environment.

Sedgwick is an equal opportunity employer and maintains a drug-free workplace. If you are interested in this role but don’t meet every qualification, we encourage you to apply anyway, as we value diverse experiences and perspectives.

Sedgwick is a global leader in risk and claims administration, assisting clients in navigating complexities through innovative AI-enabled technology. With over 33,000 colleagues and 10,000 clients across 80 countries, we deliver unparalleled support and solutions in an increasingly demanding risk landscape. For more information, visit sedgwick.com.