Data Engineering with Python

We are seeking a talented and motivated Python Data Engineer to join our dynamic team. As a Python Data Engineer, you will be responsible for designing, developing, and maintaining robust data pipelines and infrastructure to support our growing data needs. You will work closely with data scientists, analysts, and other engineers to ensure the efficient and reliable delivery of data for analysis and decision-making.

Job Responsibilities:

• Design, develop, and maintain scalable data pipelines using Python and related technologies.
• Build and optimize data storage and retrieval systems.
• Implement data quality checks and monitoring to ensure data accuracy and reliability.
• Collaborate with data scientists and analysts to understand their data requirements and provide solutions.
• Automate data processing tasks and improve overall efficiency.
• Troubleshoot and resolve data-related issues in a timely manner.
• Stay up-to-date with the latest data engineering trends and technologies.
• Participate in code reviews and contribute to the improvement of our engineering practices.
• Contribute to the development of data governance policies and procedures.
• Document data pipelines and infrastructure for maintainability and knowledge sharing.

Requirements:

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• Proven experience as a Data Engineer or similar role.
• Strong proficiency in Python and related data engineering libraries (e.g., Pandas, NumPy, PySpark).
• Experience with data warehousing solutions (e.g., Snowflake, Redshift, BigQuery).
• Experience with ETL tools and processes.
• Familiarity with data streaming technologies (e.g., Kafka, Apache Flink).
• Understanding of database concepts and SQL.
• Experience with cloud platforms (e.g., AWS, Azure, Google Cloud Platform).
• Strong problem-solving and analytical skills.
• Excellent communication and collaboration skills.
• Ability to work independently and as part of a team.