Azure Data Engineer / Warsaw
⚲ Warszawa
Do uzgodnienia
Wymagania
- Azure Data Engineering
- Python
- SQL
- Databricks
- PySpark
- Azure Data Lake
- Terraform
Opis stanowiska
Location: Warsaw, Poland
Work Model: Hybrid (2–3 days per week from Warsaw office)
Experience: 6–8 years
About the Role
We are looking for a talented Azure Data Engineer to join our growing technology team. In this role, you will design and build modern cloud-based data solutions, working with cutting-edge Microsoft Azure technologies, big data platforms, and scalable data architectures.
You will play a key role in developing reliable data pipelines, enabling real-time analytics, and supporting enterprise data transformation initiatives. If you are passionate about cloud technologies, data engineering, and building high-performance solutions, this opportunity is for you.
What You Will Do
• Design, develop, and maintain scalable data engineering solutions on Microsoft Azure.
• Build and optimize modern data pipelines supporting both batch and real-time streaming workloads.
• Develop high-performance data processing applications using Databricks and PySpark.
• Work with large-scale structured, semi-structured, and unstructured datasets.
• Implement data ingestion and processing solutions using Azure cloud services.
• Design and develop solutions based on serverless and cloud-native architectures.
• Ensure data platforms are secure, reliable, scalable, and optimized for performance.
• Collaborate with architects, developers, and business stakeholders to deliver innovative data solutions.
• Apply Infrastructure-as-Code principles for cloud resource management.
Must-Have Skills & Experience
We are looking for candidates with strong experience in:
Programming & Data Engineering
• Strong programming skills in Python.
• Advanced knowledge of SQL.
• Experience working with SQL and NoSQL databases.
• Hands-on experience with Databricks and PySpark.
• Experience developing:• Batch data processing solutions
• Structured Streaming applications
• Real-time data pipelines
Microsoft Azure Technologies
Practical experience with:
• Azure Data Lake Storage (ADLS)
•
Azure Databricks
•
Azure Event Hub
•
Azure Event Grid
•
Azure SQL Data Warehouse / Synapse Analytics
•
Azure Functions
•
Serverless Architecture
Cloud Infrastructure
• Understanding of Terraform and Infrastructure-as-Code concepts.
• Terraform theoretical knowledge is required; practical implementation experience will be an advantage.
Nice-to-Have Skills
Additional experience with:
•
Azure Data Factory (ADF)
•
Azure Resource Manager (ARM) Templates
• Kubernetes and container-based solutions
• Google Cloud Platform (GCP)
• Machine Learning and Artificial Intelligence concepts
• Integration of AI/ML capabilities into data platforms
What We Value
• Strong analytical and problem-solving skills.
• Ability to design clean, scalable, and efficient data solutions.
• Experience working in enterprise-scale environments.
• Good communication and teamwork skills.
• Curiosity and willingness to learn new technologies.
Work Model: Hybrid (2–3 days per week from Warsaw office)
Experience: 6–8 years
About the Role
We are looking for a talented Azure Data Engineer to join our growing technology team. In this role, you will design and build modern cloud-based data solutions, working with cutting-edge Microsoft Azure technologies, big data platforms, and scalable data architectures.
You will play a key role in developing reliable data pipelines, enabling real-time analytics, and supporting enterprise data transformation initiatives. If you are passionate about cloud technologies, data engineering, and building high-performance solutions, this opportunity is for you.
What You Will Do
• Design, develop, and maintain scalable data engineering solutions on Microsoft Azure.
• Build and optimize modern data pipelines supporting both batch and real-time streaming workloads.
• Develop high-performance data processing applications using Databricks and PySpark.
• Work with large-scale structured, semi-structured, and unstructured datasets.
• Implement data ingestion and processing solutions using Azure cloud services.
• Design and develop solutions based on serverless and cloud-native architectures.
• Ensure data platforms are secure, reliable, scalable, and optimized for performance.
• Collaborate with architects, developers, and business stakeholders to deliver innovative data solutions.
• Apply Infrastructure-as-Code principles for cloud resource management.
Must-Have Skills & Experience
We are looking for candidates with strong experience in:
Programming & Data Engineering
• Strong programming skills in Python.
• Advanced knowledge of SQL.
• Experience working with SQL and NoSQL databases.
• Hands-on experience with Databricks and PySpark.
• Experience developing:• Batch data processing solutions
• Structured Streaming applications
• Real-time data pipelines
Microsoft Azure Technologies
Practical experience with:
• Azure Data Lake Storage (ADLS)
•
Azure Databricks
•
Azure Event Hub
•
Azure Event Grid
•
Azure SQL Data Warehouse / Synapse Analytics
•
Azure Functions
•
Serverless Architecture
Cloud Infrastructure
• Understanding of Terraform and Infrastructure-as-Code concepts.
• Terraform theoretical knowledge is required; practical implementation experience will be an advantage.
Nice-to-Have Skills
Additional experience with:
•
Azure Data Factory (ADF)
•
Azure Resource Manager (ARM) Templates
• Kubernetes and container-based solutions
• Google Cloud Platform (GCP)
• Machine Learning and Artificial Intelligence concepts
• Integration of AI/ML capabilities into data platforms
What We Value
• Strong analytical and problem-solving skills.
• Ability to design clean, scalable, and efficient data solutions.
• Experience working in enterprise-scale environments.
• Good communication and teamwork skills.
• Curiosity and willingness to learn new technologies.
🔍 Dekoder Ogłoszenia
🟡
design and build modern cloud-based data solutions
Może oznaczać zarówno tworzenie od podstaw, jak i dostosowywanie istniejących rozwiązań do nowych standardów.
🟡
cutting-edge Microsoft Azure technologies
Może sugerować pracę z najnowszymi funkcjami Azure, które mogą być jeszcze w fazie rozwoju lub wymagać intensywnego uczenia się.
🟡
big data platforms
Zakres 'big data' jest szeroki i może oznaczać zarówno bardzo duże zbiory danych, jak i po prostu większe niż typowe dla mniejszych projektów.
🟡
scalable data architectures
Może oznaczać projektowanie z myślą o przyszłym wzroście, ale także konieczność optymalizacji obecnych rozwiązań pod kątem skalowalności.
🟡
enterprise data transformation initiatives
Może oznaczać pracę nad dużymi, złożonymi projektami transformacji danych w dużej organizacji, co wiąże się z potencjalną biurokracją i długimi cyklami wdrożeniowymi.