Senior Data Engineer

About

Responsibilities

• Lead the design, development, and operation of key data systems and pipelines, taking full ownership from ideation to production delivery.
• Partner with Finance, Marketing, People, and Enterprise analytics teams to align on data needs, priorities, and deliver reliable data workflows.
• Collaborate with the Data Platform team, Databricks, and semantic layer partners on migration and integration workstreams.
• Develop and optimize DAGs for reliability, performance, and maintainability; participate in on-call rotations and SEV handling.
• Drive post-incident investigations, produce root cause analyses, and implement long-term reliability improvements.
• Monitor system health, update dashboards, alarms, and runbooks to ensure pipeline and product health.
• Architect and build scalable batch and real-time data pipelines ensuring data quality, security, and lineage.
• Design and maintain semantic models and data assets that support self-service analytics across business stakeholders.
• Lead architectural reviews and propose improvements to reduce complexity and operational burden.
• Create thorough documentation of systems, designs, and processes to support knowledge sharing and onboarding.

Required Qualifications

• 10+ years of experience in data engineering and data platforms, with demonstrated ownership of production-grade pipelines and systems.
• Hands-on expertise with Databricks, Snowflake, and AWS cloud infrastructure.
• Experience with graph or vector databases, conversational analytics, semantic models, and building agentic applications for data engineering and operations (preferred).
• Expert-level proficiency in Python and SQL with a strong understanding of software development best practices including test automation, CI/CD, and DevOps.
• Extensive experience in big data compute and storage technologies: Spark, Trino, Hive, and cloud storage systems.
• Familiarity with semantic layer tools (e.g., Cube), BI platforms (e.g., ThoughtSpot), and orchestration frameworks (e.g., Airflow).

Education

• Bachelor’s degree in Computer Science, Engineering, or equivalent work experience.