Data Engineer/ Python Developer

Responsibilities

• Design, develop, and maintain software solutions using Python.
• Developed Python and pyspark programs for data analysis. Good working experience with python to develop Custom Framework for generating of rules (just like rules engine).
• Developed Python code to gather the data from HBase and designs the solution to implement using Pyspark. Apache Spark DataFrames/RDD's were used to apply business transformations and utilized Hive Context objects to perform read/write operations.
• Develop back-end services, APIs, and integrate databases.
• Optimize applications for performance, security, and maintainability.
• Troubleshoot and resolve software defects and issues.

Required Skills

• Strong proficiency in Python and Spark.

Regards leo.phom@staffingine.com