Skip to content
mimi

Vulnerability & Exposure Management Data Engineer (m/f/d)

Schwarz Dienstleistung KG

On-site Mid Level 2mo ago

About the role

About Us

Schwarz Digits creates the technological foundation for digital sovereignty in Europe. As the IT and digital division of the Schwarz Group, we develop and manage the IT infrastructures for the retail divisions Lidl and Kaufland, as well as Schwarz Production and PreZero. At the same time, we operate as an independent provider in the external market to support companies across Europe in their digital transformation. We bundle our core services in the areas of Cloud, Cyber Security, Data & AI, Communication, and Workspace. Join us and contribute to digital sovereignty in Europe. With us, you will work at the intersection of agility and security: You will benefit from fast decision-making processes, enjoy genuine creative freedom in your projects, and be able to build upon the stable foundation of the Schwarz Group.

Your Tasks

  • Design and develop a solution that processes millions of data entries daily for the new Vulnerability Management Platform.
  • Build and maintain scalable data pipelines (batch and real-time) to ingest high volumes of data into the data lake.
  • Perform data modeling to optimize datasets and ease data consumption for stakeholders.
  • Bring data analytics to production at scale, participating in architecture design.
  • Collaborate with Backend and Frontend teams to implement and improve the product.
  • Ensure data availability and integrity for business stakeholders.

Your Profile

  • 5+ years of experience in Software Development and Big Data Frameworks.
  • Strong proficiency in Python (must have) and advanced knowledge in PySpark.
  • Experience building data processing pipelines (ELT) using tools such as Airflow, dbt, or Airbyte.
  • Proficiency with Cloud data warehousing solutions (preferably STACKIT or AWS)
  • Experience with relational (SQL) and non-relational databases (MongoDB, Redis); Neo4j is a plus
  • Experience working in Agile environments
  • Strong English communication skills and ability to work in a collaborative, international environment.

Nice to Have:

  • Cybersecurity and Vulnerability Management knowledge or experience.
  • Familiarity with containerization (Docker, Kubernetes) and CI/CD pipelines (Azure DevOps, Jira).
  • Familiarity with monitoring and visualization tools like Azure Monitoring, Grafana, and PowerBI.
  • Contribution to open-source projects and a passion for learning new tools.

We look forward to receiving your application.

Xavier Coll Porqueres Reference no. 47989 Stiftsbergstraße 1 74172 Neckarsulm, Germany

Skills

AirflowAWSAzure DevOpsdbtDockerGrafanaJiraKubernetesMongoDBNeo4jPowerBIPythonPySparkRedisSQL

Don't send a generic resume

Paste this job description into Mimi and get a resume tailored to exactly what the hiring team is looking for.

Get started free