👉 Senior Data Engineer (AWS)
⚲ Wrocław, Rzeszów, Gdańsk
21 000 - 33 000 PLN netto (B2B)
Wymagania
- SQL
- Python
- AWS
- Airflow
- DBT
- Graph databases
Opis stanowiska
🟣 You will be:
• designing and implementing scalable data pipelines ingesting data from DynamoDB, Aurora PostgreSQL, and Neptune,
• building and maintaining data lake layers, including Raw, Canonical, and Curated zones on Amazon S3 using Apache Iceberg,
• developing ingestion frameworks supporting both CDC and batch processing patterns,
• contributing to the implementation and ongoing maintenance of the AWS Glue Data Catalog,
• developing and maintaining Airflow workflows for orchestration of data pipelines,
• implementing CI/CD practices for data platform development and deployment,
• automating testing, validation, and deployment processes across environments,
• ensuring reliable operation of development, staging, and production environments,
• optimizing query performance, storage layouts, and Iceberg table design,
• troubleshooting and resolving production issues while continuously improving platform performance and stability.
🟣 Your profile:
• 5+ years of experience in Data Engineering,
• strong Python development skills,
• advanced SQL proficiency,
• hands-on experience with AWS-based data platforms (Lake Formation, Athena, Glue, DynamoDB),
• experience building and maintaining data pipelines in Apache Airflow,
• commercial experience with dbt,
• exposure to graph databases, preferably Amazon Neptune (Neo4j, CosmosDB),
• solid knowledge of Git and CI/CD practice and Terraforn,
• experience with Apache Iceberg in production environments,
• knowledge of openLineage or similar lineage frameworks,
• experience with observability and monitoring frameworks for data platforms is a plus.
Work from the European Union region and a work permit are required.
Candidates must have an active VAT status in the EU VIES registry: https://ec.europa.eu/taxation_customs/vies/
🟣 Recruitment Process:
CV review – HR call – Technical Interview – Client Interview – Hiring Manager Interview – Decision
🎁 Benefits 🎁
✍ Development:
• development budgets of up to 6,800 PLN,
• we fund certifications e.g.: AWS, Azure,
• access to Udemy, O'Reilly (formerly Safari Books Online) and more,
• events and technology conferences,
• technology Guilds,
• internal training,
• Xebia Upskill.
🩺 We take care of your health:
• private medical healthcare,
• multiSport card - we subsidise a MultiSport card,
• mental Health Support.
🤸♂️ We are flexible:
• B2B or employment contract,
• contract for an indefinite period.
• designing and implementing scalable data pipelines ingesting data from DynamoDB, Aurora PostgreSQL, and Neptune,
• building and maintaining data lake layers, including Raw, Canonical, and Curated zones on Amazon S3 using Apache Iceberg,
• developing ingestion frameworks supporting both CDC and batch processing patterns,
• contributing to the implementation and ongoing maintenance of the AWS Glue Data Catalog,
• developing and maintaining Airflow workflows for orchestration of data pipelines,
• implementing CI/CD practices for data platform development and deployment,
• automating testing, validation, and deployment processes across environments,
• ensuring reliable operation of development, staging, and production environments,
• optimizing query performance, storage layouts, and Iceberg table design,
• troubleshooting and resolving production issues while continuously improving platform performance and stability.
🟣 Your profile:
• 5+ years of experience in Data Engineering,
• strong Python development skills,
• advanced SQL proficiency,
• hands-on experience with AWS-based data platforms (Lake Formation, Athena, Glue, DynamoDB),
• experience building and maintaining data pipelines in Apache Airflow,
• commercial experience with dbt,
• exposure to graph databases, preferably Amazon Neptune (Neo4j, CosmosDB),
• solid knowledge of Git and CI/CD practice and Terraforn,
• experience with Apache Iceberg in production environments,
• knowledge of openLineage or similar lineage frameworks,
• experience with observability and monitoring frameworks for data platforms is a plus.
Work from the European Union region and a work permit are required.
Candidates must have an active VAT status in the EU VIES registry: https://ec.europa.eu/taxation_customs/vies/
🟣 Recruitment Process:
CV review – HR call – Technical Interview – Client Interview – Hiring Manager Interview – Decision
🎁 Benefits 🎁
✍ Development:
• development budgets of up to 6,800 PLN,
• we fund certifications e.g.: AWS, Azure,
• access to Udemy, O'Reilly (formerly Safari Books Online) and more,
• events and technology conferences,
• technology Guilds,
• internal training,
• Xebia Upskill.
🩺 We take care of your health:
• private medical healthcare,
• multiSport card - we subsidise a MultiSport card,
• mental Health Support.
🤸♂️ We are flexible:
• B2B or employment contract,
• contract for an indefinite period.
🔍 Dekoder Ogłoszenia
🔴
designing and implementing scalable data pipelines
Oczekuje się, że będziesz projektować i wdrażać rozwiązania od podstaw, a nie tylko modyfikować istniejące.
🟡
contributing to the implementation and ongoing maintenance of the AWS Glue Data Catalog
Może to oznaczać zarówno aktywne tworzenie, jak i rutynowe, powtarzalne zadania związane z katalogiem danych.
🔴
troubleshooting and resolving production issues while continuously improving platform performance and stability
Będziesz odpowiedzialny za gaszenie pożarów w produkcji, a nie tylko za rozwój nowych funkcji.
🟡
5+ years of experience in Data Engineering
Chociaż podano liczbę lat, faktyczne doświadczenie i jego jakość będą kluczowe, co może oznaczać potrzebę udowodnienia konkretnych projektów.
🟡
exposure to graph databases, preferably Amazon Neptune (Neo4j, CosmosDB)
Wymagane jest doświadczenie z bazami grafowymi, ale konkretne technologie mogą być elastyczne, co może oznaczać naukę od zera.