Senior GCP Data Engineer – BigQuery & Data Pipeline Development
⚲ Krakow
26 040 - 31 500 PLN netto (B2B)
Wymagania
- SQL
- Cloud Composer/Airflow
- BigQuery
- Java
- Python
- Terraform
- Data Vault modeling
- GCP DataFusion
- ETL/ELT Pipeline Development
- Git/CI/CD
Opis stanowiska
Unleash the Power of Data – Transform Business Insights with Cutting-Edge Cloud Engineering!
Krakow-based opportunity with hybrid work model.
As a Senior GCP Data Engineer – BigQuery & Data Pipeline Development, you will be working for our client, a leading financial services organization, on a transformative data integration initiative. Your expertise will support the global MSS Operations team, enhancing data processing and analytics capabilities across multiple sources and enabling data-driven decision-making at scale. This role offers a platform for innovation and professional growth in the rapidly evolving cloud data landscape.
Your main responsibilities:
• Design, build, test, and deploy GCP data models and transformations in BigQuery (including stored procedures, indexes, clusters, partitions, triggers).
• Create and manage ETL/ELT data pipelines transforming raw or unstructured data into a Data Vault model.
• Review, interpret, and implement business and technical requirements, ensuring compliance with IT and security standards.
• Monitor data pipelines for failures or performance issues, implementing solutions for scalability and robustness.
• Optimize ETL/ELT processes to handle large data volumes efficiently.
• Integrate data from various sources, maintaining consistency and accuracy.
• Manage code artifacts and CI/CD pipelines using Git, Jenkins, Terraform, with a focus on GCP cloud applications.
• Collaborate within an Agile environment, applying DataOps best practices to deliver high-quality solutions.
You’re ideal for this role if you have:
• At least 3 years of hands-on experience with SQL querying and optimization in BigQuery.
• Proven expertise in SQL Data Transformation, ETL/ELT pipeline development in GCP DataFusion or similar tools.
• Strong experience with Data Vault modeling principles.
• Skilled in Cloud Composer/Airflow, Cloud Run, Pub/Sub, Python, and Terraform.
• Proficiency with version control (Git) and CI/CD processes, including tools like Jenkins or Ansible.
• Experience working in a DataOps environment and Agile methodologies.
• Excellent problem-solving, organizational, and multi-tasking skills.
Nice to have:
• Experience designing data ingestion pipelines with GCP Data Fusion, CDAP, or comparable tools (handling CSV, JSON, XML, RESTful & SOAP APIs, SFTP).
• Knowledge of Java development for custom Data Fusion plugins.
• Familiarity with continuous testing and deployment tools for cloud data solutions.
Language Required for the role:
• English (Communicative proficiency required)
Eligibility to work in Europe:
• Only candidates with an existing legal right to work in the European Union will be considered for this role.
#MAKEYourCareerBETTER
Interested? Apply now and include your CV (preferably in English) along with a statement confirming your consent to the processing and storage of your personal data.
Krakow-based opportunity with hybrid work model.
As a Senior GCP Data Engineer – BigQuery & Data Pipeline Development, you will be working for our client, a leading financial services organization, on a transformative data integration initiative. Your expertise will support the global MSS Operations team, enhancing data processing and analytics capabilities across multiple sources and enabling data-driven decision-making at scale. This role offers a platform for innovation and professional growth in the rapidly evolving cloud data landscape.
Your main responsibilities:
• Design, build, test, and deploy GCP data models and transformations in BigQuery (including stored procedures, indexes, clusters, partitions, triggers).
• Create and manage ETL/ELT data pipelines transforming raw or unstructured data into a Data Vault model.
• Review, interpret, and implement business and technical requirements, ensuring compliance with IT and security standards.
• Monitor data pipelines for failures or performance issues, implementing solutions for scalability and robustness.
• Optimize ETL/ELT processes to handle large data volumes efficiently.
• Integrate data from various sources, maintaining consistency and accuracy.
• Manage code artifacts and CI/CD pipelines using Git, Jenkins, Terraform, with a focus on GCP cloud applications.
• Collaborate within an Agile environment, applying DataOps best practices to deliver high-quality solutions.
You’re ideal for this role if you have:
• At least 3 years of hands-on experience with SQL querying and optimization in BigQuery.
• Proven expertise in SQL Data Transformation, ETL/ELT pipeline development in GCP DataFusion or similar tools.
• Strong experience with Data Vault modeling principles.
• Skilled in Cloud Composer/Airflow, Cloud Run, Pub/Sub, Python, and Terraform.
• Proficiency with version control (Git) and CI/CD processes, including tools like Jenkins or Ansible.
• Experience working in a DataOps environment and Agile methodologies.
• Excellent problem-solving, organizational, and multi-tasking skills.
Nice to have:
• Experience designing data ingestion pipelines with GCP Data Fusion, CDAP, or comparable tools (handling CSV, JSON, XML, RESTful & SOAP APIs, SFTP).
• Knowledge of Java development for custom Data Fusion plugins.
• Familiarity with continuous testing and deployment tools for cloud data solutions.
Language Required for the role:
• English (Communicative proficiency required)
Eligibility to work in Europe:
• Only candidates with an existing legal right to work in the European Union will be considered for this role.
#MAKEYourCareerBETTER
Interested? Apply now and include your CV (preferably in English) along with a statement confirming your consent to the processing and storage of your personal data.
🔍 Dekoder Ogłoszenia
🔴
Unleash the Power of Data – Transform Business Insights with Cutting-Edge Cloud Engineering!
To marketingowy slogan, który nie precyzuje konkretnych zadań ani technologii, a jedynie obiecuje ekscytującą pracę.
🔴
a leading financial services organization
Praca w branży finansowej często wiąże się z restrykcyjnymi procedurami, długimi cyklami wdrożeniowymi i wysokimi wymaganiami bezpieczeństwa.
🔴
transformative data integration initiative
Może oznaczać zarówno ekscytujący projekt, jak i chaotyczne, niedopracowane wdrożenie z wieloma nieprzewidzianymi problemami.
🟡
enabling data-driven decision-making at scale
Obietnica wpływu na decyzje biznesowe, która może być realizowana w różnym stopniu, od faktycznego wpływu po jedynie wsparcie analityczne.
🟡
platform for innovation and professional growth
Sugeruje możliwości rozwoju, ale nie precyzuje, czy są to formalne szkolenia, czy raczej samodzielne zdobywanie wiedzy w ramach bieżących projektów.