Lead Data Engineer (Databricks)

Job Title: Data Engineer

Location: Hyderabad / Ahmedabad (Hybrid)

Experience: 7+ Years

Key Responsibilities:

Required Skills: Python, Pyspark, SQL, Databricks

Please apply if you can join in less than 30 days.

About the Role:

We are seeking a Data Engineer with 7+ years of experience to develop scalable and high-performance data solutions. The ideal candidate will have strong expertise in Python, PySpark, SQL, and Databricks, along with a deep understanding of big data processing and cloud technologies.

Key Responsibilities: • Design, develop, and enhance ETL/ELT data pipelines using Python and PySpark. • Build and maintain large-scale data processing frameworks with Databricks. • Write and optimize SQL queries, stored procedures, and data models for efficient data management. • Work with both structured and unstructured data to enable business intelligence and analytics. • Ensure data pipeline efficiency, scalability, and reliability through continuous optimization. • Implement data governance, security, and compliance best practices. • Collaborate closely with data scientists, analysts, and business stakeholders to deliver data-driven insights. • Identify and resolve data quality issues, performance bottlenecks, and system failures in production environments.

Must-Have Skills:

Python – Proficient in writing clean, efficient, and scalable code for data processing.

PySpark – Hands-on experience with distributed data processing and optimization.

SQL – Strong ability to write complex queries and optimize database performance.

Databricks – Practical experience in building and managing large-scale data solutions.