Lead Data Engineer

About

Become a vital part of a dynamic data pod as a Lead Data Engineer. Focus on delivering large-scale data solutions and innovative streaming architectures in AWS environments. In this position, you will utilize your deep domain knowledge in big data systems and data engineering within a client-driven context. You’ll take charge of data architectural direction while actively participating in implementation tasks, optimizing streaming solutions, and leading collaborative efforts. Your expertise in tools like Redshift, DBT, and CI/CD processes will be essential for the success of the role.

Responsibilities

• Own the architectural course for streaming data from GCP
• Develop resilient ingestion frameworks with robust monitoring
• Implement data processing pipelines using Spark/PySpark
• Optimize ETL/ELT processes in Amazon Redshift
• Conduct rigorous performance tuning and testing for DBT

Requirements

• 6+ years in big data engineering experience
• Proven track record of streaming architecture
• Strong optimization skills for Amazon Redshift
• Experience creating CI/CD pipelines for data
• Background in client-oriented delivery settings

Leverage your engineering expertise to craft solutions that enhance streaming data architectures and ensure optimal data practices.