Data Engineer

O projekcie: As a Data Engineer you will help build and operate CDPR’s modern cloud-based Data Platform. This is a hands on engineering role with real ownership over pipelines, integrations and data workflows used across the studio. Wymagania: - 5+ years in Data Engineering or Big Data in a production environment. - Experience building and orchestrating data pipelines in a cloud environment using Airflow. - Strong programming in Python. - Very good SQL and experience with PostgreSQL, MS SQL or Oracle. - Understanding of data modeling and dimensional design. - Practical experience building pipelines in a cloud environment. - Experience working with workflow orchestration tools. - Experience building integrations using REST APIs. - Familiarity with Git based workflows (GitLab CI/CD). Nice to have - Experience with BigQuery/Snowflake. - Hands on experience in dbt (data build tool). - Basic Docker/Kubernetes knowledge. - Java or scripting experience (Bash/PowerShell). - Experience with Terraform or other infrastructure-as-code tools. Codzienne zadania: - Build and maintain ETL/ELT pipelines. - Develop scalable data pipelines in Airflow and develop data models in modern data warehouses like BigQuery or Snowflake. - Design and evolve data processing workflows in our GCP environment. - Create and maintain data layers for integrations and analytics and reporting. - Ensure data quality through monitoring, validation and automated exception handling. - Build system integrations using REST APIs and Python based services. - Troubleshoot pipeline performance, stability and orchestration issues.