Skip to content
mimi

[Remote] Lead Data Engineer (Databricks – Manufacturing/MES) Architect

Novaedge

Remote (Global) Lead 3d ago

About the role

About the Role

Note: The job is a remote job and is open to candidates in USA.
VTekis Consulting LLP provides complete solutions for Staff Augmentation and Recruitment Process Outsourcing. They are seeking a Lead Data Engineer to design and optimize scalable data pipelines using Azure Databricks while integrating and processing MES data and supporting manufacturing analytics.

Responsibilities

  • Design, build, and optimize scalable data pipelines using Azure Databricks (PySpark, Spark SQL, Delta Lake)
  • Integrate and process MES data, shop-floor data, IoT/sensor data, and ERP systems
  • Architect modern data solutions supporting manufacturing analytics and operational reporting
  • Lead data engineering best practices including performance tuning, optimization, and governance
  • Work closely with manufacturing stakeholders to translate MES data requirements into scalable data models
  • Ensure high data quality, reliability, and production-grade deployments

Skills

  • Strong hands-on expertise in Azure Databricks (Delta Lake, PySpark, Spark architecture)
  • Proven experience in Manufacturing domain, especially working with MES systems and production data
  • Experience building real-time or near-real-time data pipelines
  • Strong SQL and data modeling skills
  • Experience with cloud platforms (Azure preferred)
  • Ability to function as both technical architect and hands-on developer
  • Excellent communication skills and ability to work in PST time zone
  • Experience with IoT data ingestion and streaming technologies
  • Exposure to data warehousing and BI integration
  • Experience leading small data engineering team

Company Overview

  • We provide Recruitment and Staffing services to many industries and domain through our innovative and customized solutions and passionate commitment to research.
  • It was founded in 2020, and is headquartered in Alpharetta, Georgia, USA, with a workforce of 51-200 employees.
  • Its website is Company

H1B Sponsorship

  • VTekis Consulting LLC has a track record of offering H1B sponsorships, with 2 in 2025. Please note that this does not guarantee sponsorship for this specific role.

Apply tot his job.

Skills

Azure DatabricksDelta LakeERPIoTMESPySparkSpark SQLSpark architectureSQL

Don't send a generic resume

Paste this job description into Mimi and get a resume tailored to exactly what the hiring team is looking for.

Get started free