Senior Data Engineer (Databricks)
⚲ Warszawa
Do uzgodnienia
Wymagania
- Python
- Databricks
- Kafka
- SQL
Opis stanowiska
Nasze wymagania:
Solid commercial experience in Data Engineering, with hands-on expertise in Databricks.
Strong proficiency in Python (focused on automation and data transformation).
Experience working with at least one major cloud platform: AWS, Azure, or GCP.
Strong communication skills and excellent command of the English language.
Mile widziane:
SQL - solid understanding, including query optimization and data modeling.
DevOps approach - familiarity with CI/CD pipelines and Infrastructure as Code (Terraform, Bicep).
Experience with real-time data streaming technologies (e.g., Kafka, Spark Streaming).
Knowledge of cloud storage solutions and data warehouses (e.g., Data Lake, Snowflake, Synapse).
PySpark - hands-on experience in distributed data processing.
Industry certifications
O projekcie:
You will become part of a thriving team of over 400 professionals for whom data is more than just numbers. We create advanced, scalable architectures on AWS, Azure, and GCP platforms. We work based on the full Software Development Life Cycle (SDLC), leveraging modern frameworks, proven methodologies, and DevOps best practices. We provide an environment where innovation counts and your ideas are always welcome. If you like a modern approach to data engineering, you will feel right at home with us!
Zakres obowiązków:
Design and implement highly efficient data processing solutions for large-scale and diverse datasets using Databricks.
Design, build, and enhance data pipelines leveraging Python and modern cloud-native tools.
Work closely with Solution Architects to jointly define and uphold the best market practices in data engineering.
Ensure data consistency, security, and scalability within distributed cloud-based environments.
Solid commercial experience in Data Engineering, with hands-on expertise in Databricks.
Strong proficiency in Python (focused on automation and data transformation).
Experience working with at least one major cloud platform: AWS, Azure, or GCP.
Strong communication skills and excellent command of the English language.
Mile widziane:
SQL - solid understanding, including query optimization and data modeling.
DevOps approach - familiarity with CI/CD pipelines and Infrastructure as Code (Terraform, Bicep).
Experience with real-time data streaming technologies (e.g., Kafka, Spark Streaming).
Knowledge of cloud storage solutions and data warehouses (e.g., Data Lake, Snowflake, Synapse).
PySpark - hands-on experience in distributed data processing.
Industry certifications
O projekcie:
You will become part of a thriving team of over 400 professionals for whom data is more than just numbers. We create advanced, scalable architectures on AWS, Azure, and GCP platforms. We work based on the full Software Development Life Cycle (SDLC), leveraging modern frameworks, proven methodologies, and DevOps best practices. We provide an environment where innovation counts and your ideas are always welcome. If you like a modern approach to data engineering, you will feel right at home with us!
Zakres obowiązków:
Design and implement highly efficient data processing solutions for large-scale and diverse datasets using Databricks.
Design, build, and enhance data pipelines leveraging Python and modern cloud-native tools.
Work closely with Solution Architects to jointly define and uphold the best market practices in data engineering.
Ensure data consistency, security, and scalability within distributed cloud-based environments.
🔍 Dekoder Ogłoszenia
🔴
Solid commercial experience in Data Engineering, with hands-on expertise in Databricks.
Oczekują, że będziesz samodzielnie rozwiązywać problemy i podejmować decyzje dotyczące architektury danych, a nie tylko wykonywać polecenia.
🔴
We create advanced, scalable architectures on AWS, Azure, and GCP platforms.
Prawdopodobnie będziesz pracować w środowisku multi-cloud, co może oznaczać konieczność dostosowania się do różnych narzędzi i praktyk.
🟡
We work based on the full Software Development Life Cycle (SDLC), leveraging modern frameworks, proven methodologies, and DevOps best practices.
Może to oznaczać, że procesy są dobrze zdefiniowane, ale też że oczekuje się od Ciebie ścisłego przestrzegania ustalonych procedur.
🔴
We provide an environment where innovation counts and your ideas are always welcome.
Choć brzmi zachęcająco, może to oznaczać, że oczekuje się od Ciebie proaktywnego zgłaszania pomysłów i inicjatywy, a nie tylko wykonywania zadań.
🟡
If you like a modern approach to data engineering, you will feel right at home with us!
Może to sugerować, że firma szybko wdraża nowe technologie, co wymaga ciągłego uczenia się i adaptacji.