Senior Data Engineer (Databricks)
⚲ Kraków
24 000 - 32 000 PLN netto (B2B) | 20 300 - 27 100 PLN brutto (UoP)
Wymagania
- Databricks
- Python
- SQL
- Spark
- Kafka
- Azure Event Hubs
- Terraform
- CloudFormation
Opis stanowiska
Grape Up is a consulting & technology company, helping enterprises create the most important applications by leveraging AI & cloud-native technologies and modern ways of delivering software.
At Grape Up, we transform businesses by unlocking the potential of AI and data through innovative software solutions.
We partner with industry leaders, from the automotive, aviation and manufacturing industries, to build sophisticated Data & Analytics platforms that transform how organizations manage and leverage their data assets. Our solutions provide comprehensive capabilities spanning data storage, management, advanced analytics, machine learning, and AI, enabling enterprises to accelerate innovation and make data-driven decisions.
Responsibilities
• Design and implement a scalable architecture capable of handling the high volume of sensor, telemetry, and simulation data
• Build a flexible data preprocessing pipelines that are extensible and that can be integrated into customer’s existing platform
• Develop and implement processes and best practices for data management and governance
• Optimize and enhance system setup and improve data structures following industry best practices
• Collaborate effectively with data engineering team members while partnering closely with analytics and data science teams to meet user needs
• Collaborate with business stakeholders and technical teams to understand data requirements, translate business needs into technical solutions
Requirements
• Master’s degree in computer science, Data Engineering, AI, or a related field
• 5+ years of professional experience in Data Engineering and Big Data, building production-grade data platforms and pipelines
• Proven experience with the Databricks platform (Azure Databricks or Databricks on AWS), including Unity Catalog and Delta Lake / Lakehouse architecture
• Strong experience with Apache Spark (PySpark), including performance optimization, and large-scale data processing
• Proficiency in Python and SQL for data transformations and analytics workloads
• Experience with data pipeline orchestration
• Experience with data governance and quality frameworks
• Strong problem-solving skills and ability to work independently
• Fluency in English and Polish, both written and spoken
Nice to have
• Data Engineer (Databricks) certificate
• Experience processing high-volume Automotive or IoT data (e.g., telemetry, sensor, or event-based data)
• Experience with streaming tools like Kafka, Azure Event Hubs, or similar
• Experience with Infrastructure as Code (Terraform, CloudFormation)
Benefits
• Non-corporate work environment among experienced engineers
• Individual growth & development plan supported by cyclical feedback sessions
• Access to knowledge platforms (e.g. Pluralsight)
• Equipment of your choice
• Financing of conferences, external trainings, and certifications
• Language lessons (English, German and Polish for foreigners)
• LuxMed private medical care
• Weekly Lunch & Learn where we meet up in the office, lunch together, and share our knowledge
• Employee referral program
• Rewards for the success of the month and year awarded by our employees
• Special rewards for your years with us (G-Man)
• Integration activities
At Grape Up, we transform businesses by unlocking the potential of AI and data through innovative software solutions.
We partner with industry leaders, from the automotive, aviation and manufacturing industries, to build sophisticated Data & Analytics platforms that transform how organizations manage and leverage their data assets. Our solutions provide comprehensive capabilities spanning data storage, management, advanced analytics, machine learning, and AI, enabling enterprises to accelerate innovation and make data-driven decisions.
Responsibilities
• Design and implement a scalable architecture capable of handling the high volume of sensor, telemetry, and simulation data
• Build a flexible data preprocessing pipelines that are extensible and that can be integrated into customer’s existing platform
• Develop and implement processes and best practices for data management and governance
• Optimize and enhance system setup and improve data structures following industry best practices
• Collaborate effectively with data engineering team members while partnering closely with analytics and data science teams to meet user needs
• Collaborate with business stakeholders and technical teams to understand data requirements, translate business needs into technical solutions
Requirements
• Master’s degree in computer science, Data Engineering, AI, or a related field
• 5+ years of professional experience in Data Engineering and Big Data, building production-grade data platforms and pipelines
• Proven experience with the Databricks platform (Azure Databricks or Databricks on AWS), including Unity Catalog and Delta Lake / Lakehouse architecture
• Strong experience with Apache Spark (PySpark), including performance optimization, and large-scale data processing
• Proficiency in Python and SQL for data transformations and analytics workloads
• Experience with data pipeline orchestration
• Experience with data governance and quality frameworks
• Strong problem-solving skills and ability to work independently
• Fluency in English and Polish, both written and spoken
Nice to have
• Data Engineer (Databricks) certificate
• Experience processing high-volume Automotive or IoT data (e.g., telemetry, sensor, or event-based data)
• Experience with streaming tools like Kafka, Azure Event Hubs, or similar
• Experience with Infrastructure as Code (Terraform, CloudFormation)
Benefits
• Non-corporate work environment among experienced engineers
• Individual growth & development plan supported by cyclical feedback sessions
• Access to knowledge platforms (e.g. Pluralsight)
• Equipment of your choice
• Financing of conferences, external trainings, and certifications
• Language lessons (English, German and Polish for foreigners)
• LuxMed private medical care
• Weekly Lunch & Learn where we meet up in the office, lunch together, and share our knowledge
• Employee referral program
• Rewards for the success of the month and year awarded by our employees
• Special rewards for your years with us (G-Man)
• Integration activities
🔍 Dekoder Ogłoszenia
🟡
helping enterprises create the most important applications by leveraging AI & cloud-native technologies and modern ways of delivering software.
Firma zajmuje się tworzeniem aplikacji dla dużych firm, wykorzystując nowoczesne technologie, ale nie precyzuje, jakiego rodzaju są to aplikacje ani jakie konkretnie technologie są kluczowe.
🟡
partner with industry leaders, from the automotive, aviation and manufacturing industries, to build sophisticated Data & Analytics platforms
Praca z dużymi, znanymi firmami z konkretnych branż, co może oznaczać pracę nad złożonymi, ale potencjalnie sztywnymi projektami.
🟡
Design and implement a scalable architecture capable of handling the high volume of sensor, telemetry, and simulation data
Oczekuje się projektowania systemów, które poradzą sobie z dużą ilością danych, co może oznaczać pracę nad trudnymi problemami wydajnościowymi i optymalizacyjnymi.
🔴
Build a flexible data preprocessing pipelines that are extensible and that can be integrated into customer’s existing platform
Konieczność tworzenia elastycznych rozwiązań, które muszą pasować do istniejących, często nieidealnych systemów klientów, co może prowadzić do kompromisów technicznych.
🟡
Collaborate effectively with data engineering team members while partnering closely with analytics and data science teams to meet user needs
Wymagana jest ścisła współpraca z innymi zespołami, co może oznaczać wiele spotkań i konieczność godzenia różnych priorytetów i perspektyw.