Data Engineer with Airflow

About

Dice is the leading career destination for tech experts at every stage of their careers. Our client, METANLYTICS LLC, is seeking the following.

Role Details

• Location: Wilmington DE - Look for Nearby candidates
• Work Type: F2F Is Required For This Role.
• Candidate Type: W2 Candidates only

Must Have

• 7+ years experience
• Python - PySpark or Java Spark
• Airflow
• AWS, Data Lake or Databricks
• EMR / Mapreduce
• Relational DB

Preferred

• NOSQL
• Terraform
• Scala

Responsibilities

• Software engineering concepts with over 7+ years of applied experience
• Develops secure and high-quality production code, and reviews and debugs code written by others
• Drives decisions that influence the product design, application functionality, and technical operations and processes

Qualifications

• Degree in Computer Science, Computer Engineering, Mathematics, or a related technical field
• Extensive hands-on experience with PySpark/ Java/Spark and ETL/Streaming Pipelines
• Experience with AWS services such as SQS, Lambda, S3, and RDS
• Advanced proficiency in one or more programming languages, such as Java, or Python