Data Engineer with AWS
DCG sp. z o.o.
⚲ Poland
21 840 - 26 880 PLN (B2B)
Wymagania
- AWS Glue
- Data pipelines
- Spark
- SQL
- Data models
- Data warehouses
- Data engineering
- Python
- AWS S3
- AWS Lambda
- Redshift
- Data management
- GitLab
- IaC
- Terraform
- Analytical skills
- ETL
- AWS
- PowerBI (nice to have)
Opis stanowiska
O projekcie: Offer: - Private medical care - Co-financing for the sports card - Constant support of dedicated consultant - Employee referral program Wymagania: Requirements: - 4–6 years of experience as Data Engineer - Strong SQL and Python skills (production-grade code) - Hands-on experience with AWS (Glue/S3/Lambda/Redshift) - Knowledge of data management principles and best practices, including data governance, data quality, and data integration - Practical experience in managing CI/CD pipelines (GitLab) and IaC (Terraform) - Excellent problem-solving and analytical skills, with the ability to identify and resolve complex data engineering issues - Experience designing ETL/ELT pipelines - Experience working in Agile environment - Knowledge of English C1 Nice to have: - Experience with using PowerBI Codzienne zadania: - Design and implement scalable batch data pipelines on AWS using AWS Glue - Develop and optimize data transformations using Apache Spark and SQL, ensuring performance and maintainability - Design efficient data models for analytical and reporting use cases (data lakes, data warehouses) - Ensure data reliability, quality, monitoring, and performance in distributed environments - Engage directly with business to understand requirements and translate them into data engineering solutions - Work independently while maintaining effective communication with stakeholders