Senior Data Engineer (Databricks)
⚲ Warszawa, Kraków, Wrocław
18 480 - 25 200 PLN netto (B2B)
Wymagania
- Databricks
- Python
- SQL
- ETL/ELT
- cloud environments (Azure, AWS or GCP)
- medallion architecture
- Git and CI/CD
Opis stanowiska
About the role
We are looking for a Senior Data Engineer with strong Databricks experience to build and optimize modern data platforms. You will develop scalable ETL/ELT pipelines, process large datasets and contribute to the evolution of cloud-native Data Engineering solutions.
Responsibilities:
• Design, develop and maintain scalable ETL/ELT pipelines
• Build reliable batch and streaming data processing solutions
• Develop data pipelines using Databricks and Apache Spark
• Optimize Spark jobs and improve platform performance
• Work with Delta Lake and Medallion Architecture
• Build and maintain data models for analytics and reporting
• Ensure data quality, monitoring and observability
• Collaborate with Architects, Data Scientists and Analytics teams
• Participate in code reviews and technical improvements
• Contribute to CI/CD processes and engineering best practices
Requirements:
• 5+ years of experience in Data Engineering
• 2+ years of commercial experience with Databricks
• Strong knowledge of PySpark and Spark SQL
• Excellent SQL skills
• Strong Python programming skills
• Experience building ETL/ELT pipelines
• Experience working with Delta Lake
• Good understanding of Medallion Architecture
• Experience with cloud environments (Azure, AWS or GCP)
• Experience with Git and CI/CD
• Understanding of data modelling principles
• Good communication skills
• Fluent English - C1
Nice to have:
• Unity Catalog experience
• dbt
• Kafka or Structured Streaming
• Airflow or Databricks Workflows
• Databricks certification
• Experience with performance tuning and cost optimization
We are looking for a Senior Data Engineer with strong Databricks experience to build and optimize modern data platforms. You will develop scalable ETL/ELT pipelines, process large datasets and contribute to the evolution of cloud-native Data Engineering solutions.
Responsibilities:
• Design, develop and maintain scalable ETL/ELT pipelines
• Build reliable batch and streaming data processing solutions
• Develop data pipelines using Databricks and Apache Spark
• Optimize Spark jobs and improve platform performance
• Work with Delta Lake and Medallion Architecture
• Build and maintain data models for analytics and reporting
• Ensure data quality, monitoring and observability
• Collaborate with Architects, Data Scientists and Analytics teams
• Participate in code reviews and technical improvements
• Contribute to CI/CD processes and engineering best practices
Requirements:
• 5+ years of experience in Data Engineering
• 2+ years of commercial experience with Databricks
• Strong knowledge of PySpark and Spark SQL
• Excellent SQL skills
• Strong Python programming skills
• Experience building ETL/ELT pipelines
• Experience working with Delta Lake
• Good understanding of Medallion Architecture
• Experience with cloud environments (Azure, AWS or GCP)
• Experience with Git and CI/CD
• Understanding of data modelling principles
• Good communication skills
• Fluent English - C1
Nice to have:
• Unity Catalog experience
• dbt
• Kafka or Structured Streaming
• Airflow or Databricks Workflows
• Databricks certification
• Experience with performance tuning and cost optimization
🔍 Dekoder Ogłoszenia
✓ Ogłoszenie wygląda transparentnie — brak typowych czerwonych flag.