Big Data Engineer

About

Our client, a leading organization in the technology and data solutions sector, is seeking a Big Data Engineer to join their team. As a Big Data Engineer, you will be part of the Data Engineering Department supporting cross-functional teams. The ideal candidate will have strong problem-solving skills, excellent communication, and a proactive mindset, which will align successfully in the organization.

Responsibilities

• Design, develop, and maintain large-scale data processing pipelines using Big Data technologies such as Hadoop, Spark, Python, and Scala.
• Architect and deploy containerized big data workloads on Amazon EMR on EKS (Elastic Kubernetes Service).
• Design and implement Kubernetes-based infrastructure for running Spark applications at scale.
• Implement data ingestion, storage, transformation, and analysis solutions that are scalable, efficient, and reliable.
• Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.

Qualifications

• Bachelor's Degree in Computer Science, Information Systems, or related discipline.
• Experience with Big Data technologies such as Hadoop, Spark, Hive, and Trino.
• Strong knowledge of Kubernetes architecture, concepts, and operations, including Amazon EKS.
• Proficiency with AWS services like S3, EMR, Glue, Lambda, and Athena.
• Programming skills in Python or Scala, with a solid understanding of functional programming concepts.

Benefits

• Opportunity to work with cutting-edge Big Data and cloud technologies.
• Engagement with a dynamic and innovative team environment.
• Chance to develop and enhance your technical expertise in a fast-paced setting.
• Supportive work culture that values diversity and inclusion.
• Potential for career growth and professional development.

Upon completion of waiting period consultants are eligible for:

• Medical and Prescription Drug Plans
• Dental Plan
• Vision Plan
• Health Savings Account
• Health Flexible Spending Account
• Dependent Care Flexible Spending Account
• Supplemental Life Insurance
• Short Term and Long Term Disability Insurance
• Business Travel Insurance
• 401(k), Plus Match
• Weekly Pay