Data Architect - Databricks

About the project 
The project focuses on one of the largest data warehouse platforms within the Lufthansa Group. The platform collects and processes data related to bookings, tickets, journeys, customers, B2B contracts, loyalty programmes and flight schedules.
As part of our modernization journey, we are migrating from Teradata to Databricks and building a modern, scalable data platform. This role offers the opportunity to influence architectural decisions, shape future data solutions and work with complex data ecosystems in an international environment.
We work according to Agile principles, placing strong emphasis on collaboration, knowledge sharing and continuous development.
 
Responsibilities:
• Translate business requirements into scalable and sustainable data solutions.
• Design data architectures, data models and integration patterns supporting current and future business needs.
• Support architectural decision-making and provide technical guidance to the development team.
• Support the migration from Teradata to Databricks by analyzing current solutions and recommending improvements as part of the organization's data platform modernization journey.
• Design, develop and improve data processing solutions, integrations and data pipelines in collaboration with the DWH Product Owner.
• Collaborate closely with business stakeholders to define requirements, validate solutions and prepare Proofs of Concept.
• Ensure solution quality, performance, scalability and maintainability.
• Prepare technical documentation, effort estimations and architectural recommendations.
• Continuously improve technical standards, best practices and knowledge within the team.

Requirements:
• 5+ years of professional experience in Data Engineering, Data Architecture or Data Warehousing.
• Strong experience with SQL and database procedural languages (e.g. T-SQL, PL/SQL).
• Experience in designing and implementing scalable data solutions and architectures.
• Hands-on experience with Databricks and modern data platforms.
• Good knowledge of PySpark and Python (Pandas, NumPy).
• Experience in database optimization, performance tuning, partitioning and index/statistics management.
• Understanding of data modelling principles and data integration patterns.
• Experience with version control systems (e.g. Git).
• Strong ownership and commitment to delivering high-quality solutions.
• Motivation to learn, grow and make a meaningful impact on the team and the products.
• A genuine interest in data engineering, with a proactive approach to exploring new technologies and improving existing solutions.
• Good command of spoken and written English (B2/C1).
• Strong analytical, problem-solving and communication skills.
• Experience with cloud-based data platforms.
• Availability to work from the Gdańsk office 2 days per week.

Nice to have:
• Experience with large-scale data migration projects.
• Knowledge of Teradata.
• Knowledge of Unix/Linux systems.
• Familiarity with Agile/Scrum methodologies.
• Experience with Data Governance or Data Quality frameworks.
• Experience creating functional documentation.
• Good command of spoken and written Polish.

What we offer:
• An international working environment, atmosphere that stimulates development.
• Individual career path.
• Stable employment under an employment contract.
• Salary in the range of 14-25 000 zł brutto for the Data Architect position.
• Lufthansa Group membership benefits.
• Flexible working time and place adjusted to employee’s needs. Possibility of starting your workday between 07:00 and 11:00.
• Support for your passion for sports within the local activity group and co-financing Multisport cards.
• Private medical care for employees and their family members.
• Life insurance.
• Parking space for employees.
• Extra social benefits.
• Holiday funds.
• Sharing the costs of holidays for kids.
• Sharing the commuting costs.
• Modern office in Oliwa – great location and comfortable workspace.