Senior IT Data Engineer - Onsite

About

Dice is the leading career destination for tech experts at every stage of their careers. Our client, VIVA USA INC, is seeking the following.

Description

Participates in the planning and execution of policies, practices, and projects that acquire, control, protect, and enhance the value of data assets. Facilitates obtaining data from a variety of different sources, in the right formats, assuring that it adheres to data quality standards, as well as resolving any information flow and content issues. Builds a robust data pipeline that cleans, transforms, and aggregates unorganized data into databases.

Proficiency in developing, maintaining, monitoring, and the long-term operations of data pipelines or processing systems running in Cloudera Data Platform. Understanding of data extraction, transformation, loading, and performance tuning of solutions utilizing multiple streams of input data code-based, git and DevOps-enabled technologies using Python or SQL such as PySpark, pandas, or dbt

Requirements

• 5+ years of experience in application/data development (i.e., Python)
• 5+ years of experience with data integration/ingestion tools (i.e., Apache NiFi)
• Advanced level knowledge of SQL, Java, Microsoft SQL Server, distributed data/computing platforms (i.e., Apache NiFi, Hadoop, MapReduce, Hive, HBase, Kafka, Spark)
• Experience with Scrum and Kanban methodologies
• Experience with UNIX/Linux including basic commands and shell scripting
• Experience in implementing and maintaining continuous integration continuous delivery (CI/CD) pipelines and data platform management

About VIVA USA

VIVA USA is an equal opportunity employer and is committed to maintaining a professional working environment that is free from discrimination and unlawful harassment. The Management, contractors, and staff of VIVA USA shall respect others without regard to race, sex, religion, age, color, creed, national or ethnic origin, physical, mental or sensory disability, marital status, sexual orientation, or status as a Vietnam-era, recently separated veteran, Active war time or campaign badge veteran, Armed forces service medal veteran, or disabled veteran. Please contact us at for any complaints, comments and suggestions.

Contact Details

Account co-ordinator: Binodh M.T, VIVA USA INC. 3601 Algonquin Road, Suite 425 Rolling Meadows, IL 60008