Data Engineer (BigQuery / GCP) (m/f/d)
⚲ Łódź, Bałuty
Do uzgodnienia
Wymagania
- Google Cloud Platform
- SQL
- Git
- Python
Opis stanowiska
Nasze wymagania:
High knowledge of BigQuery / SQL
Good knowledge of GCP Data Engineering
Mile widziane:
Basic Python knowledge
Basic knowledge of Git / CI/CD
O projekcie:
Our team is part of Cost Processing & Transactions cluster. The cluster provides standard reporting for controlling group costs, processes the accounts payable and travel expense reports, and makes the system landscape available to numerous customers in the CFO department. We are a diverse international team with around 150 employees in Frankfurt, Bremen, Hamburg, Lodz and Prague and have clients in Germany and abroad. We are responsible for around 200 accounting and controlling processes and 45 IT products, from A as accounting to Z like Zet-Visions, and are therefore active in the heart of Commerzbank. With systems created by our team we are meeting demands which cannot be met by “box” products. We develop and maintain applications used in controlling environment (group and segment controlling) which provide planning, analysis and reporting functions. Working close with business we are able to quickly adapt them to current regulations and needs.
Zakres obowiązków:
Develop and optimize BigQuery datasets, views and queries (partitioning, clustering, materialized views) to meet performance and cost targets.
Build and maintain ELT/ETL pipelines into BigQuery (e.g., via Cloud Storage, Pub/Sub, Dataflow, Dataproc, or vendor sources), including monitoring and error handling.
Model data for analytics (dimensional and/or data vault concepts) and define data quality checks, lineage and documentation for curated datasets.
Collaborate with business and IT stakeholders to translate requirements into technical specifications, implement changes, and support testing and release activities.
Ensure operational stability and security (IAM, service accounts, dataset access, auditability), troubleshoot
incidents, and continuously improve reliability and automation.
High knowledge of BigQuery / SQL
Good knowledge of GCP Data Engineering
Mile widziane:
Basic Python knowledge
Basic knowledge of Git / CI/CD
O projekcie:
Our team is part of Cost Processing & Transactions cluster. The cluster provides standard reporting for controlling group costs, processes the accounts payable and travel expense reports, and makes the system landscape available to numerous customers in the CFO department. We are a diverse international team with around 150 employees in Frankfurt, Bremen, Hamburg, Lodz and Prague and have clients in Germany and abroad. We are responsible for around 200 accounting and controlling processes and 45 IT products, from A as accounting to Z like Zet-Visions, and are therefore active in the heart of Commerzbank. With systems created by our team we are meeting demands which cannot be met by “box” products. We develop and maintain applications used in controlling environment (group and segment controlling) which provide planning, analysis and reporting functions. Working close with business we are able to quickly adapt them to current regulations and needs.
Zakres obowiązków:
Develop and optimize BigQuery datasets, views and queries (partitioning, clustering, materialized views) to meet performance and cost targets.
Build and maintain ELT/ETL pipelines into BigQuery (e.g., via Cloud Storage, Pub/Sub, Dataflow, Dataproc, or vendor sources), including monitoring and error handling.
Model data for analytics (dimensional and/or data vault concepts) and define data quality checks, lineage and documentation for curated datasets.
Collaborate with business and IT stakeholders to translate requirements into technical specifications, implement changes, and support testing and release activities.
Ensure operational stability and security (IAM, service accounts, dataset access, auditability), troubleshoot
incidents, and continuously improve reliability and automation.
🔍 Dekoder Ogłoszenia
🔴
High knowledge of BigQuery / SQL
Oczekiwana jest zaawansowana znajomość SQL i BigQuery, co może oznaczać konieczność optymalizacji złożonych zapytań i struktur danych.
🔴
Good knowledge of GCP Data Engineering
Chociaż określone jako 'dobre', może to oznaczać potrzebę praktycznego doświadczenia z różnymi usługami GCP w kontekście inżynierii danych, a nie tylko teoretyczną wiedzę.
🔴
Basic Python knowledge
Określenie 'podstawowa' może oznaczać, że faktyczne wykorzystanie Pythona będzie większe niż sugeruje nazwa, np. do skryptowania lub integracji.
🔴
Basic knowledge of Git / CI/CD
Podobnie jak w przypadku Pythona, 'podstawowa' wiedza może okazać się niewystarczająca, jeśli w praktyce wymagane jest aktywne zarządzanie repozytoriami i procesami CI/CD.
🔴
We develop and maintain applications used in controlling environment (group and segment controlling) which provide planning, analysis and reporting functions.
Praca może wymagać głębokiego zrozumienia specyfiki procesów księgowych i controllingowych, co wykracza poza czystą inżynierię danych.