Data Engineer

About

Drive innovative software solutions as a skilled Data Engineer. Utilize Python and PySpark for data analysis, custom frameworks, and integrated back-end services while maintaining high performance and security.

In this role, you will design, develop, and maintain robust software solutions using Python. You will also create Python programs for data analysis, employing PySpark to manage data from HBase and implement business transformations using Apache Spark DataFrames or RDDs. Anticipate integrating back-end services, APIs, and databases to optimize application performance.

Leverage your Python and data engineering skills to craft powerful software solutions that enhance performance and reliability.

Key Responsibilities:

• Design and implement software solutions using Python
• Develop Python and PySpark programs for analysis
• Integrate and maintain databases and back-end services
• Optimize applications for security and performance
• Troubleshoot and resolve software defects efficiently

Requirements:

• Proficient in Python and PySpark programming
• Experience with HBase and Apache Spark
• Knowledge of back-end services integration
• Strong analytical and problem-solving skills
• Familiarity with performance optimization techniques