Data Engineer Databricks / Lakehouse (w/m/d)

About Us

1&1 is one of the leading telecommunications providers in Germany with over 3,100 employees and almost 16 million customer contracts. With pioneering spirit, unusual ideas and creative teams, we have conquered a leading market position in mobile communications and broadband connections. By combining the 1&1 fiber optic network, which is over 67,000 km long, and regional networks, we are creating Germany's most extensive fiber optic network. We are also building Europe's most modern 5G network based on the novel Open-RAN technology. With open interfaces and 5G functions in a powerful cloud infrastructure. Continue the 1&1 success story by shaping the future through the use and development of innovative technologies. Become part of 1&1.

Your Tasks

In this role, you will actively shape the transformation of our data landscape towards a modern, scalable Lakehouse architecture on Databricks. You will create the foundation for data-driven decisions and innovative AI use cases.

• Design, development and operation of modern ETL/ELT pipelines based on Python (e.g. PySpark) in Databricks
• Replacement of existing data warehouse and ETL structures (MS SQL Server, Stored Procedures, Automic) with scalable Lakehouse architectures
• Building differentiated pipeline logics to ensure stability, SLA compliance and auditability
• Implementation of data quality checks (validation, reconciliation, quality checks)
• Ensuring data consistency during the migration of existing systems
• Implementation of transformations, schema mappings and metadata enrichment according to the target architecture
• Optimization of data pipelines regarding performance, costs and scalability
• Use of modern Databricks functionalities (e.g. Delta Lake, Structured Streaming)
• Monitoring of pipeline runtimes, resource usage and system stability
• Close cooperation with BI, Analytics, Architecture and Development teams as well as specialist departments
• Creation and maintenance of technical documentation as well as ensuring traceability and governance

What We're Looking For

• Completed studies (e.g. Computer Science, Data Engineering, Business Informatics or comparable)
• Several years of experience (approx. 3-6 years) in Data Engineering
• Very good Python skills (esp. PySpark) as well as sound experience with Apache Spark and ideally Databricks
• Strong understanding of ETL/ELT processes, data modeling and pipeline orchestration
• Experience with Microsoft SQL Server as well as very good SQL skills
• Analytical, structured and solution-oriented way of working
• Experience with Databricks Lakehouse, Delta Lake and Structured Streaming
• Knowledge of orchestration tools (e.g. Airflow, Databricks Workflows)
• Understanding of Data Governance, Compliance and Metadata Management

What Else We Want to Tell You

• Attractive salary
• Strong community of team players
• Trust-based working hours with flexible scheduling and the option to work remotely up to 40%
• Numerous further training opportunities on- and offline
• Discounts on 1&1 products and for various leisure activities
• Company restaurant
• Free drinks and fresh fruit
• Jobrad subsidy

Diversity enriches. Different cultures, nationalities, genders, age groups, sexual orientations and religions, as well as people with disabilities – we want diversity and we promote it. Because only teams that reflect all facets of society offer the best conditions for creativity and make a company productive and unique. We value diversity and welcome all applications.

Contact

Questions?

1&1 Telecommunication SE Recruiting jobs@1und1.de

Please use our straightforward online form exclusively for your application, so that we can ensure the most transparent application process possible while complying with all data protection regulations. Unfortunately, we cannot consider applications by email for the reasons mentioned.