Expert Data Engineer with GCP
⚲ Kraków
17 400 - 26 700 PLN (PERMANENT)
Wymagania
- Python
- GCP
- BigQuery
- Apache Airflow
- ETL
- Spark
- NoSQL
- Relational database
- Apache Beam (nice to have)
Opis stanowiska
O projekcie:
What will you do?
You will join a modern data platform initiative focused on building scalable data solutions in Google Cloud Platform. The project involves designing and developing robust data pipelines, data models, and cloud-based data solutions that support business-critical analytics and decision-making. As an Expert Data Engineer, you will contribute deep technical expertise, solve complex data challenges, and help ensure the platform is reliable, scalable, and maintainable.
We offer you
- Hybrid work from our client's office (Kraków) 4 days a month- Working in a highly experienced and dedicated team- Benefit package that can be tailored to your personal needs (private medical coverage, sport & recreation package, lunch subsidy, life insurance, etc.)- Online training and certifications aligned with your career path- Access to e-learning platforms- Social events
Wymagania:
- 5+ years of experience in Data Engineering or a related field- Expert-level Python programming skills- Strong hands-on experience with Google Cloud Platform, including BigQuery, Cloud Storage, Compute Engine, or GKE- Extensive experience with ETL/ELT and data integration pipelines- Strong expertise in Apache Airflow for workflow orchestration- Hands-on experience with Spark- Strong understanding of data architecture and data modeling concepts- Experience working with large and complex datasets- Strong knowledge of relational databases- Experience with NoSQL databases- Good understanding of data quality and data governance principles- Strong analytical and problem-solving skills- Ability to work independently on complex technical challenges
Nice to have skills
- Apache Beam
Codzienne zadania:
- Design, develop, and maintain scalable data pipelines and ETL/ELT processes
- Build and manage Apache Airflow DAGs for workflow orchestration
- Develop data processing logic using Python and frameworks such as DBT or Spark
- Work with BigQuery and Cloud SQL to store, process, and transform large datasets
- Design and implement efficient data models and integration solutions
- Ensure data quality, integrity, reliability, and performance across the platform
- Analyze and resolve complex data engineering challenges
- Collaborate with business stakeholders to translate requirements into scalable data solutions
- Maintain technical documentation and contribute to platform improvements
- Support deployment, monitoring, and optimization of data solutions in GCP environments
- Participate in code reviews and promote engineering best practices
What will you do?
You will join a modern data platform initiative focused on building scalable data solutions in Google Cloud Platform. The project involves designing and developing robust data pipelines, data models, and cloud-based data solutions that support business-critical analytics and decision-making. As an Expert Data Engineer, you will contribute deep technical expertise, solve complex data challenges, and help ensure the platform is reliable, scalable, and maintainable.
We offer you
- Hybrid work from our client's office (Kraków) 4 days a month- Working in a highly experienced and dedicated team- Benefit package that can be tailored to your personal needs (private medical coverage, sport & recreation package, lunch subsidy, life insurance, etc.)- Online training and certifications aligned with your career path- Access to e-learning platforms- Social events
Wymagania:
- 5+ years of experience in Data Engineering or a related field- Expert-level Python programming skills- Strong hands-on experience with Google Cloud Platform, including BigQuery, Cloud Storage, Compute Engine, or GKE- Extensive experience with ETL/ELT and data integration pipelines- Strong expertise in Apache Airflow for workflow orchestration- Hands-on experience with Spark- Strong understanding of data architecture and data modeling concepts- Experience working with large and complex datasets- Strong knowledge of relational databases- Experience with NoSQL databases- Good understanding of data quality and data governance principles- Strong analytical and problem-solving skills- Ability to work independently on complex technical challenges
Nice to have skills
- Apache Beam
Codzienne zadania:
- Design, develop, and maintain scalable data pipelines and ETL/ELT processes
- Build and manage Apache Airflow DAGs for workflow orchestration
- Develop data processing logic using Python and frameworks such as DBT or Spark
- Work with BigQuery and Cloud SQL to store, process, and transform large datasets
- Design and implement efficient data models and integration solutions
- Ensure data quality, integrity, reliability, and performance across the platform
- Analyze and resolve complex data engineering challenges
- Collaborate with business stakeholders to translate requirements into scalable data solutions
- Maintain technical documentation and contribute to platform improvements
- Support deployment, monitoring, and optimization of data solutions in GCP environments
- Participate in code reviews and promote engineering best practices
🔍 Dekoder Ogłoszenia
🔴
modern data platform initiative focused on building scalable data solutions in Google Cloud Platform
Prawdopodobnie będziesz pracować nad czymś, co jest w fazie rozwoju, a nie nad dojrzałym, stabilnym produktem.
🔴
contribute deep technical expertise, solve complex data challenges
Oczekuje się, że będziesz samodzielnie rozwiązywać problemy, które mogą być trudne i czasochłonne.
🔴
Hybrid work from our client's office (Kraków) 4 days a month
Pomimo że jest to praca hybrydowa, większość czasu będziesz spędzać w biurze klienta, co może być uciążliwe.
🔴
Benefit package that can be tailored to your personal needs
Pakiet benefitów może być podstawowy, a możliwość jego dopasowania może być ograniczona do kilku opcji.
🔴
Expert-level Python programming skills
Oczekuje się biegłości w Pythonie, która wykracza poza podstawy i obejmuje zaawansowane techniki i biblioteki.