Data Engineer

About

We are seeking a skilled and motivated Data Engineer to join our team. The ideal candidate will have strong experience in building and maintaining scalable data pipelines and infrastructure, with a focus on cloud technologies, particularly AWS. This role requires proficiency in Python and SQL, and offers opportunities to work with modern data platforms like Databricks.

Key Responsibilities:

• Design, develop, and maintain robust data pipelines and ETL processes.
• Work with large-scale datasets to ensure data integrity, quality, and availability.
• Collaborate with data scientists, analysts, and other engineers to support data needs.
• Optimize data workflows for performance and scalability in cloud environments.
• Implement data governance and security best practices.

Required Qualifications:

• Proficiency in Python and SQL for data manipulation and pipeline development.
• Hands-on experience with AWS services such as S, Lambda, Glue, IAM, etc.
• Strong understanding of data modeling, warehousing, and distributed systems.
• Experience with version control systems (, Git) and CI/CD pipelines.

Preferred Qualifications:

• Experience with Databricks or similar data platforms.
• Familiarity with Java for backend or data-related development.
• Exposure to API development and integration with data services.

Nice to Have:

• Knowledge of data lake architectures and real-time data processing.
• Experience with orchestration tools like Airflow or AWS Step Functions.
• Understanding of Dev Ops practices in data engineering contexts.