Data Engineer (Azure Databricks)
iTeamly
⚲ Kraków, Warszawa
26 040 - 31 920 PLN (B2B)
Wymagania
- Data engineering
- Communication skills
- Cloud
- PySpark
- Databricks
- SQL
- Azure SQL
- Azure
- BI (nice to have)
- Databricks certification (nice to have)
- Azure certifications (nice to have)
Opis stanowiska
O projekcie: We are looking for an experienced Data Engineer with strong PySpark skills to join a large-scale Azure data platform project. You will work in a distributed environment, focusing on building and optimizing data pipelines. What we offer - 100% remote work - International project environment - Modern data stack (Azure + Databricks) - Fast recruitment process - Long-term cooperation Benefits - sharing the costs of sports activities - life insurance Wymagania: - 5+ years of experience in Data Engineering - Strong hands-on experience with: PySpark (DataFrames, optimization techniques); Databricks; SQL - Experience with Azure services: Data Factory; Azure SQL / Storage - Knowledge of cloud environments (preferably Azure) - Strong problem-solving skills and ability to work independently - Good communication skills in English (B2+) Optional - Power BI - Azure certifications (AZ-900 or similar) - Databricks certification Codzienne zadania: - Develop and maintain data pipelines using PySpark and SQL - Work with Azure Databricks for large-scale data processing - Build and maintain ingestion and data transformation workflows - Perform data wrangling and integrate multiple data sources - Optimize Spark jobs (DataFrames, partitioning, clustering, SparkSQL) - Work with data formats such as Delta, Parquet, and CSV - Collaborate with stakeholders across multiple time zones - Create and maintain technical documentation