Databricks Data Engineer
DEVAPO SPÓŁKA Z OGRANICZONĄ ODPOWIEDZIALNOŚCIĄ
⚲ Warszawa, Ochota
100–140 zł netto (+ VAT) / godz.
Wymagania
- Azure Data Factory
- Azure Synapse Analytics
- Azure Data Lake
- Databricks
- Apache Spark
- SQL
- Delta Lake
- Python
- Scala
- Java
- Azure DevOps
- Azure Event Hubs
- Kafka
- Azure Pureview
Opis stanowiska
Nasze wymagania:
Minimum 3 years of experience in a Data Engineer role or similar position
Strong knowledge of Azure data services (Azure Data Factory, Azure Synapse Analytics, Azure Data Lake)
Extensive experience with Databricks and Apache Spark
Proficiency in SQL and experience with relational databases
Experience in creating and optimizing data pipelines (ETL/ELT) in cloud environments
Strong programming skills in Python, Scala, or Java
Experience with Delta Lake architecture and optimization techniques
Knowledge of data modeling and schema design
Mile widziane:
Experience with Azure DevOps and CI/CD pipelines for data solutions
Knowledge of Databricks Delta Live Tables and Databricks workflows
Experience with real-time data processing using Azure Event Hubs or Kafka
Familiarity with Azure Purview or other data governance tools
Databricks or Azure certifications
O projekcie:
We are looking for an experienced Data Engineer responsible for planning, developing, and maintaining cloud environments for our clients.
Zakres obowiązków:
Design, implement, and maintain scalable and efficient data pipelines in Azure and Databricks
Develop and optimize ETL processes using Azure Data Factory and Databricks
Build Big Data solutions aligned with business requirements
Collaborate with Data Science, BI, and development teams to ensure high-quality data
Monitor performance of data processing systems and implement improvements
Implement data security standards and practices
Research and evaluate new technologies in the data engineering space
Oferujemy:
Salary: 100 - 140 zł/h+ VAT (B2B contract)
Co-financing for training and certifications, as well as guaranteed time for learning during working hours
Private medical care and a Multisport card
Language classes (English)
Flexible working hours
Team integration meetings and company events
Employee referral program with a bonus
An individually tailored career development path
Minimum 3 years of experience in a Data Engineer role or similar position
Strong knowledge of Azure data services (Azure Data Factory, Azure Synapse Analytics, Azure Data Lake)
Extensive experience with Databricks and Apache Spark
Proficiency in SQL and experience with relational databases
Experience in creating and optimizing data pipelines (ETL/ELT) in cloud environments
Strong programming skills in Python, Scala, or Java
Experience with Delta Lake architecture and optimization techniques
Knowledge of data modeling and schema design
Mile widziane:
Experience with Azure DevOps and CI/CD pipelines for data solutions
Knowledge of Databricks Delta Live Tables and Databricks workflows
Experience with real-time data processing using Azure Event Hubs or Kafka
Familiarity with Azure Purview or other data governance tools
Databricks or Azure certifications
O projekcie:
We are looking for an experienced Data Engineer responsible for planning, developing, and maintaining cloud environments for our clients.
Zakres obowiązków:
Design, implement, and maintain scalable and efficient data pipelines in Azure and Databricks
Develop and optimize ETL processes using Azure Data Factory and Databricks
Build Big Data solutions aligned with business requirements
Collaborate with Data Science, BI, and development teams to ensure high-quality data
Monitor performance of data processing systems and implement improvements
Implement data security standards and practices
Research and evaluate new technologies in the data engineering space
Oferujemy:
Salary: 100 - 140 zł/h+ VAT (B2B contract)
Co-financing for training and certifications, as well as guaranteed time for learning during working hours
Private medical care and a Multisport card
Language classes (English)
Flexible working hours
Team integration meetings and company events
Employee referral program with a bonus
An individually tailored career development path
🔍 Dekoder Ogłoszenia
🔴
planning, developing, and maintaining cloud environments for our clients
Może oznaczać zarówno tworzenie od podstaw, jak i utrzymywanie istniejących, często niedoskonałych, środowisk.
🔴
Build Big Data solutions aligned with business requirements
Może oznaczać tworzenie rozwiązań od zera lub dostosowywanie istniejących do nowych, często niejasno zdefiniowanych, potrzeb biznesowych.
🟡
Collaborate with Data Science, BI, and development teams
Wymaga umiejętności komunikacyjnych i potencjalnie rozwiązywania konfliktów między różnymi zespołami o odmiennych priorytetach.
🔴
Monitor performance of data processing systems and implement improvements
Może oznaczać proaktywne szukanie problemów lub reagowanie na zgłoszenia o spadku wydajności, często w już istniejących, złożonych systemach.
🔴
Implement data security standards and practices
Może oznaczać zarówno tworzenie nowych standardów, jak i wdrażanie istniejących, które mogą być niekompletne lub trudne do zastosowania.