Expert Data Consultant with GCP
⚲ Kraków
26 040 - 34 944 PLN (B2B)
Wymagania
- Python
- GCP
- BigQuery
- Apache Airflow
- ETL
- Spark
- NoSQL
- Relational database
- Apache Beam (nice to have)
Opis stanowiska
O projekcie:
What will you do?
You will join a modern data platform initiative focused on building scalable data solutions in Google Cloud Platform. The project involves designing and developing robust data pipelines, data models, and cloud-based data solutions that support business-critical analytics and decision-making. As an Expert Data Engineer, you will contribute deep technical expertise, solve complex data challenges, and help ensure the platform is reliable, scalable, and maintainable.
Wymagania:
- 5+ years of experience in Data Engineering or a related field- Expert-level Python programming skills- Strong hands-on experience with Google Cloud Platform, including BigQuery, Cloud Storage, Compute Engine, or GKE- Extensive experience with ETL/ELT and data integration pipelines- Strong expertise in Apache Airflow for workflow orchestration- Hands-on experience with Spark- Strong understanding of data architecture and data modeling concepts- Experience working with large and complex datasets- Strong knowledge of relational databases- Experience with NoSQL databases- Good understanding of data quality and data governance principles- Strong analytical and problem-solving skills- Ability to work independently on complex technical challenges- Openness to work hybrid from our client's office 4 days a month
Nice to have skills
- Apache Beam
Codzienne zadania:
- Design, develop, and maintain scalable data pipelines and ETL/ELT processes
- Build and manage Apache Airflow DAGs for workflow orchestration
- Develop data processing logic using Python and frameworks such as DBT or Spark
- Work with BigQuery and Cloud SQL to store, process, and transform large datasets
- Design and implement efficient data models and integration solutions
- Ensure data quality, integrity, reliability, and performance across the platform
- Analyze and resolve complex data engineering challenges
- Collaborate with business stakeholders to translate requirements into scalable data solutions
- Maintain technical documentation and contribute to platform improvements
- Support deployment, monitoring, and optimization of data solutions in GCP environments
- Participate in code reviews and promote engineering best practices
What will you do?
You will join a modern data platform initiative focused on building scalable data solutions in Google Cloud Platform. The project involves designing and developing robust data pipelines, data models, and cloud-based data solutions that support business-critical analytics and decision-making. As an Expert Data Engineer, you will contribute deep technical expertise, solve complex data challenges, and help ensure the platform is reliable, scalable, and maintainable.
Wymagania:
- 5+ years of experience in Data Engineering or a related field- Expert-level Python programming skills- Strong hands-on experience with Google Cloud Platform, including BigQuery, Cloud Storage, Compute Engine, or GKE- Extensive experience with ETL/ELT and data integration pipelines- Strong expertise in Apache Airflow for workflow orchestration- Hands-on experience with Spark- Strong understanding of data architecture and data modeling concepts- Experience working with large and complex datasets- Strong knowledge of relational databases- Experience with NoSQL databases- Good understanding of data quality and data governance principles- Strong analytical and problem-solving skills- Ability to work independently on complex technical challenges- Openness to work hybrid from our client's office 4 days a month
Nice to have skills
- Apache Beam
Codzienne zadania:
- Design, develop, and maintain scalable data pipelines and ETL/ELT processes
- Build and manage Apache Airflow DAGs for workflow orchestration
- Develop data processing logic using Python and frameworks such as DBT or Spark
- Work with BigQuery and Cloud SQL to store, process, and transform large datasets
- Design and implement efficient data models and integration solutions
- Ensure data quality, integrity, reliability, and performance across the platform
- Analyze and resolve complex data engineering challenges
- Collaborate with business stakeholders to translate requirements into scalable data solutions
- Maintain technical documentation and contribute to platform improvements
- Support deployment, monitoring, and optimization of data solutions in GCP environments
- Participate in code reviews and promote engineering best practices
🔍 Dekoder Ogłoszenia
🔴
modern data platform initiative focused on building scalable data solutions in Google Cloud Platform
Projekt może być na wczesnym etapie rozwoju, co oznacza potencjalne zmiany architektury i wymagań.
🔴
contribute deep technical expertise, solve complex data challenges
Oczekuje się, że będziesz samodzielnie rozwiązywać problemy, które mogą być trudne i czasochłonne.
🔴
Ability to work independently on complex technical challenges
Oznacza to, że będziesz musiał radzić sobie z trudnymi zadaniami bez ciągłego wsparcia.
🔴
Openness to work hybrid from our client's office 4 days a month
Wymaga to częstych podróży do biura klienta, co może być uciążliwe.
🟡
Expert Data Consultant with GCP
Tytuł sugeruje wysoki poziom wiedzy, ale rzeczywiste zadania mogą być bardziej operacyjne niż strategiczne.