Senior Data Consultant (Python, GCP, Airflow)

O projekcie:
What will you do?

You will join a modern data platform initiative focused on building scalable data solutions in Google Cloud Platform. The project involves designing robust data pipelines, developing data models, and ensuring reliable and high-quality data for business decision-making. You will collaborate with cross-functional teams to deliver efficient and maintainable data architecture.

Wymagania:
- Strong proficiency in Python for backend or data processing- Hands-on experience with Google Cloud Platform including BigQuery, Cloud Storage, Compute Engine or GKE- Experience with Apache Airflow for workflow orchestration- Strong experience with ETL and data integration pipelines- Experience with Spark- Knowledge of NoSQL databases- Strong knowledge of relational databases- Strong understanding of data architecture- Good understanding of data quality- Strong understanding of data integration- Openness to work 4 days a month from our client's office (Kraków)

Nice to have skills:
- Familiarity with Apache Beam

Codzienne zadania:
- Design, develop, and maintain scalable data pipelines and ETL processes
- Build and manage Apache Airflow DAGs for workflow orchestration
- Develop data processing logic using Python and frameworks like DBT or Spark
- Work with BigQuery and Cloud SQL to store and transform data
- Implement and maintain data architecture and data models
- Ensure data quality, integrity, and reliability
- Collaborate with business stakeholders to translate requirements into data solutions
- Maintain technical documentation and contribute to data standards
- Support deployment and monitoring of pipelines in GCP environments
- Participate in code reviews and improve engineering best practices