Data Engineer Expert in Big Data Solutions and Analytics
ShyftLabs
About the role
Transform data into impactful solutions as a Data Engineer. Leverage your expertise in Apache Spark, SQL, and cloud platforms in a hybrid work environment to drive insights.
This is a significant role for a seasoned Data Engineer focusing on designing, developing, and optimizing data solutions. You will collaborate with cross-functional teams, utilizing tools like Databricks and cloud services (AWS, Azure, or GCP) to enhance data architectures. Your contributions will ensure high-performance data processing and governance standards.
Key Responsibilities:
• Design and optimize big data pipelines in Databricks
• Develop scalable ETL workflows for large datasets
• Leverage Apache Spark for real-time analytics
• Implement data governance and security policies
• Monitor and troubleshoot Databricks clusters and jobs
Requirements:
• Bachelor’s or Master’s in Computer Science or related field
• 5+ years of experience with Databricks and Apache Spark
• Proficiency in SQL and Python for data analysis
• Experience with cloud platforms for data engineering
• Strong problem-solving skills for fast-paced tasks.
Use your skills to drive data excellence and make a substantial impact on business outcomes. #J-18808-Ljbffr
Don't send a generic resume
Paste this job description into Mimi and get a resume tailored to exactly what the hiring team is looking for.
Get started free