Databricks Data Engineer
DEVAPO SPÓŁKA Z OGRANICZONĄ ODPOWIEDZIALNOŚCIĄ
⚲ Warszawa, Ochota
100–140 zł netto (+ VAT) / godz.
Wymagania
- Azure Data Factory
- Azure Synapse Analytics
- Azure Data Lake
- Databricks
- Apache Spark
- SQL
- Delta Lake
- Python
- Scala
- Java
- Azure DevOps
- Azure Event Hubs
- Kafka
- Azure Pureview
Opis stanowiska
Nasze wymagania: Minimum 3 years of experience in a Data Engineer role or similar position Strong knowledge of Azure data services (Azure Data Factory, Azure Synapse Analytics, Azure Data Lake) Extensive experience with Databricks and Apache Spark Proficiency in SQL and experience with relational databases Experience in creating and optimizing data pipelines (ETL/ELT) in cloud environments Strong programming skills in Python, Scala, or Java Experience with Delta Lake architecture and optimization techniques Knowledge of data modeling and schema design Mile widziane: Experience with Azure DevOps and CI/CD pipelines for data solutions Knowledge of Databricks Delta Live Tables and Databricks workflows Experience with real-time data processing using Azure Event Hubs or Kafka Familiarity with Azure Purview or other data governance tools Databricks or Azure certifications O projekcie: We are looking for an experienced Data Engineer responsible for planning, developing, and maintaining cloud environments for our clients. Zakres obowiązków: Design, implement, and maintain scalable and efficient data pipelines in Azure and Databricks Develop and optimize ETL processes using Azure Data Factory and Databricks Build Big Data solutions aligned with business requirements Collaborate with Data Science, BI, and development teams to ensure high-quality data Monitor performance of data processing systems and implement improvements Implement data security standards and practices Research and evaluate new technologies in the data engineering space Oferujemy: Salary: 100 - 140 zł/h+ VAT (B2B contract) Co-financing for training and certifications, as well as guaranteed time for learning during working hours Private medical care and a Multisport card Language classes (English) Flexible working hours Team integration meetings and company events Employee referral program with a bonus An individually tailored career development path