Senior Data Engineer
DCG
⚲ Warszawa, Gdańsk, Gdynia
150 - 175 PLN/h netto (B2B)
Wymagania
- ETL
- PL/SQL
- Kafka
- SQL
- Python
Opis stanowiska
Responsibilities: • Design, build and maintain scalable ELT pipeline • Develop and optimize PLSQL queries and database objects for high performance data storage in Oracle • Write python-based data engineering scripts to process data • Implement CI/CD pipelines for data infrastructure and workflow automation • Understand and have experience of database change management • Work one or more of the major cloud vendor • Integrate and manage modern data stack • Monitor, debug and optimize data workflows and infrastructure performance • Ensure data quality, governance, and compliance with good practices Requirements: • Experience with designing OLAP systems and applying techniques such as STAR schema and denormalization • Proficiency in Python and PL/SQL development • Experience with ELT/ETL development using GUI-based tools such as IBM DataStage, Azure Data Factory (ADF), Stitch, and Matillion • Knowledge of database management systems including Oracle, MS SQL Server, and Snowflake • Understanding of DevOps and CI/CD practices, including Git, Docker, Kubernetes, Terraform, and CI/CD tools such as Jenkins, Bamboo, and Azure DevOps • Experience with test automation tools such as Robot Framework and Selenium, including knowledge of different test scenarios • Knowledge of version control systems including Git, GitHub, and GitLab • Experience with workflow orchestration tools such as Airflow and Prefect • Knowledge of streaming and batch processing concepts, including Kafka • Very good command of English, both spoken and written Offer: • Private medical care • Co-financing for the sports card • Constant support of dedicated consultant • Employee referral program