Databricks Engineer

About

Insight Global is hiring a Databricks Engineer to support a global consumer healthcare client. This role focuses on building and optimizing end-to-end data pipelines that power enterprise analytics. You will ingest and transform data from multiple internal and external sources—including commercial, supply chain, finance, POS, and vendor datasets—using Databricks and Python. You will collaborate closely with data modelers and BI teams to ensure data is curated, standardized, and performant for downstream consumption in Power BI and AI/ML workflows.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.

Skills and Requirements

• 4+ years of experience as a Data Engineer supporting enterprise analytics platforms
• Strong Databricks experience with Python-based ETL and data pipeline development
• Hands-on experience ingesting, transforming, and optimizing large-scale datasets
• Experience working with structured commercial, supply chain, or financial data
• Familiarity with data governance concepts such as Unity Catalog (or similar)
• Experience supporting semantic layers or metrics layers for BI and AI/ML use cases
• Exposure to Snowflake and cloud data lakehouse architectures
• Prior experience in CPG, retail, or consumer analytics environments