Senior Data Engineer
⚲ Poznań, Wilda
Do uzgodnienia
Wymagania
- Databricks
- Azure DevOps
- Kafka
Opis stanowiska
Nasze wymagania:
3-5+ years of experience in data engineering (the specific tech stack is flexible - we value your way of thinking and problem‑solving above tools)
Strong consulting mindset or experience working closely with business stakeholders, with the ability to ask the right questions, challenge assumptions and translate business needs into technical solutions
End‑to‑end ownership approach - from designing and building solutions to monitoring, improving and maintaining them
Excellent communication and collaboration skills, enabling you to work effectively across teams and influence decisions
Degree in Computer Science/Engineering or equivalent hands‑on experience
Experience with Databricks, Spark and streaming technologies (e.g., Kafka) - a strong plus
Proficiency in English at a minimum B2 level, spoken and written
O projekcie:
Our data platform is already there in cloud, already in Databricks. But we’re not here to maintain the status quo – we’re rebuilding it from the ground up to jump into exciting world of real-time data and streaming.
We will migrate from a batch-oriented Airflow + Databricks to a streaming-first architecture: Kafka, Databricks with new cool features like Declarative Pipelines, Unity Catalog, Apache Iceberg / Polaris Catalog, and new serving layer, which you will help us to select.
This is a greenfield build inside a global company – real budget, real data, real stakes. No startup chaos, but real room to make meaningful architectural decisions.
Zakres obowiązków:
You'll be the go-to Databricks expert on the team. You'll have important role in the migration from the legacy stack while designing and building the new platform in parallel – and “in parallel” is doing real work in that sentence.
The legacy platform runs. Not beautifully, but it runs – and it serves real business needs that can't wait for the migration to finish. You'll split your time between keeping it stable (and gradually less painful) and building its replacement. If the idea of legacy firefighting makes you want to close this tab, this probably isn't the right role. If you see it as part of the job and take quiet satisfaction in fixing things that are broken – read on.
You will work on:
- Design & build the new streaming platform (Kafka → Databricks with Declarative Pipelines)
- Migrate existing batch workflows from Airflow + Docker + on‑prem Databricks to cloud‑native architecture
- Keep the current platform stable while improving its reliability, performance and operability
- Architect the serving layer
- Govern data properly – Unity Catalog, lineage, access control, data quality – not as an afterthought
- Enable sharing across organization with Polaris and Iceberg
- Collaborate with data scientists, ML engineers, and business teams across regions
- Use AI tools daily – we use GitHub Copilot and internal homemade assistants/agents we build on our own within a team; we expect you to help the team get real value from them
Oferujemy:
By joining our team, you become a part of the people-centric work environment of a Danish company. We offer you a competitive salary, permanent contract after the probation period, development package, team building events, activity-based office in Poznan’s city center in the new prestigious office building – Nowy Rynek. The building is recognized as a building without barriers, which means that it is fully adapted to the needs of people with disabilities.
Our compensation package for employment contracts includes:
• An office-first approach: home office is available up to 2 days per week
• Adaptable Hours: start your workday anytime between 7:00 AM and 9:00 AM
• Home office subsidy
• Private Medical Care
• Multikafeteria MyBenefit
• Wellbeing program
• Extra Day Off for voluntary activities
… and while in the office you can also use modern office space with beautiful view and high standard furniture, bicycle parking facilities & showers, chill-out rooms with PlayStation, football table, pool table, board games, subsidized canteen with delicious food & fruit.
3-5+ years of experience in data engineering (the specific tech stack is flexible - we value your way of thinking and problem‑solving above tools)
Strong consulting mindset or experience working closely with business stakeholders, with the ability to ask the right questions, challenge assumptions and translate business needs into technical solutions
End‑to‑end ownership approach - from designing and building solutions to monitoring, improving and maintaining them
Excellent communication and collaboration skills, enabling you to work effectively across teams and influence decisions
Degree in Computer Science/Engineering or equivalent hands‑on experience
Experience with Databricks, Spark and streaming technologies (e.g., Kafka) - a strong plus
Proficiency in English at a minimum B2 level, spoken and written
O projekcie:
Our data platform is already there in cloud, already in Databricks. But we’re not here to maintain the status quo – we’re rebuilding it from the ground up to jump into exciting world of real-time data and streaming.
We will migrate from a batch-oriented Airflow + Databricks to a streaming-first architecture: Kafka, Databricks with new cool features like Declarative Pipelines, Unity Catalog, Apache Iceberg / Polaris Catalog, and new serving layer, which you will help us to select.
This is a greenfield build inside a global company – real budget, real data, real stakes. No startup chaos, but real room to make meaningful architectural decisions.
Zakres obowiązków:
You'll be the go-to Databricks expert on the team. You'll have important role in the migration from the legacy stack while designing and building the new platform in parallel – and “in parallel” is doing real work in that sentence.
The legacy platform runs. Not beautifully, but it runs – and it serves real business needs that can't wait for the migration to finish. You'll split your time between keeping it stable (and gradually less painful) and building its replacement. If the idea of legacy firefighting makes you want to close this tab, this probably isn't the right role. If you see it as part of the job and take quiet satisfaction in fixing things that are broken – read on.
You will work on:
- Design & build the new streaming platform (Kafka → Databricks with Declarative Pipelines)
- Migrate existing batch workflows from Airflow + Docker + on‑prem Databricks to cloud‑native architecture
- Keep the current platform stable while improving its reliability, performance and operability
- Architect the serving layer
- Govern data properly – Unity Catalog, lineage, access control, data quality – not as an afterthought
- Enable sharing across organization with Polaris and Iceberg
- Collaborate with data scientists, ML engineers, and business teams across regions
- Use AI tools daily – we use GitHub Copilot and internal homemade assistants/agents we build on our own within a team; we expect you to help the team get real value from them
Oferujemy:
By joining our team, you become a part of the people-centric work environment of a Danish company. We offer you a competitive salary, permanent contract after the probation period, development package, team building events, activity-based office in Poznan’s city center in the new prestigious office building – Nowy Rynek. The building is recognized as a building without barriers, which means that it is fully adapted to the needs of people with disabilities.
Our compensation package for employment contracts includes:
• An office-first approach: home office is available up to 2 days per week
• Adaptable Hours: start your workday anytime between 7:00 AM and 9:00 AM
• Home office subsidy
• Private Medical Care
• Multikafeteria MyBenefit
• Wellbeing program
• Extra Day Off for voluntary activities
… and while in the office you can also use modern office space with beautiful view and high standard furniture, bicycle parking facilities & showers, chill-out rooms with PlayStation, football table, pool table, board games, subsidized canteen with delicious food & fruit.
🔍 Dekoder Ogłoszenia
🔴
the specific tech stack is flexible - we value your way of thinking and problem‑solving above tools
Firma szuka kogoś, kto potrafi rozwiązywać problemy, ale może nie mieć jasno określonych wymagań technologicznych, co może oznaczać brak stabilności lub częste zmiany w stosie technologicznym.
🔴
Strong consulting mindset or experience working closely with business stakeholders, with the ability to ask the right questions, challenge assumptions and translate business needs into technical solutions
Oczekuje się, że kandydat będzie pełnił rolę pośrednika między biznesem a IT, co może oznaczać dużo komunikacji i potencjalnie konfliktów interesów lub niejasnych wymagań.
🔴
End‑to‑end ownership approach - from designing and building solutions to monitoring, improving and maintaining them
Kandydat będzie odpowiedzialny za cały cykl życia projektu, co może oznaczać bardzo szeroki zakres obowiązków i potencjalnie przeciążenie pracą.
🔴
we’re rebuilding it from the ground up to jump into exciting world of real-time data and streaming
Projekt jest w fazie gruntownej przebudowy, co może oznaczać niepewność, potencjalne problemy z migracją i nieprzewidziane trudności.
🟡
No startup chaos, but real room to make meaningful architectural decisions.
Chociaż firma zapewnia, że nie ma chaosu startupowego, fraza 'real room to make meaningful architectural decisions' może sugerować, że proces decyzyjny może być długi i skomplikowany w dużej korporacji.