Lead Data Engineer for AWS Solutions

About

Drive streaming data architecture as a Lead Data Engineer in an AWS environment. Utilize expertise in big data engineering and DBT to deliver transformative data solutions for clients.

This role focuses on delivering large-scale data engineering solutions within a cloud-native AWS setup. You'll define the architectural direction for streaming ingestion from GCP and optimize data warehousing practices using DBT in Redshift. Collaborating directly with client teams, you will ensure resilient data processing and adhere to high-quality engineering standards.

Leverage your deep data engineering skills to drive innovative solutions and enhance client outcomes in the sports and entertainment sectors.

Responsibilities

• Own architectural direction for GCP to AWS streaming data
• Design resilient ingestion frameworks with monitoring strategies
• Implement distributed processing pipelines using Spark/Py Spark
• Create scalable data warehouses and ETL processes in Redshift
• Conduct DBT performance tuning for optimal efficiency

Requirements

• 6+ years in big data engineering environments
• Proven experience with streaming architectures
• Hands-on expertise in DBT and its components
• Strong Redshift architecture and optimization skills
• Experience in client-facing delivery contexts