GCP Data Engineer
emagine Polska
⚲ Lisbon
Wymagania
- Data Engineering
- Microsoft Platform
- Atlassian JIRA
- Atlassian Confluence
- Docker
- Git
- Cloud
- Grafana
- Kubernetes
- DevOps
Opis stanowiska
GCP Data Engineer We are seeking a skilled GCP Data Engineer with 5 to 6 years of experience in data engineering and ingestion pipelines. The ideal candidate possesses extensive knowledge of cloud data platforms, particularly Google Cloud Platform (GCP), and has the capability to handle large volumes of data and recurring flows. Ability to work with existing technical specifications is essential. Main Responsibilities: • Designing and implementing data pipelines in GCP. • Managing large-scale data ingestion processes. • Collaborating with development teams to refine technical specifications. • Monitoring and optimizing data flow performance. • Ensuring data quality and compliance with standards. Key Requirements: • 5+ years of experience in data engineering. • Proficiency in dbt. • Extensive experience with BigQuery. • Strong knowledge of Google Cloud Storage. • Familiarity with Cloud Run. • Experience with Google Kubernetes Engine (GKE). • Proficient in Docker. • Understanding of Git and DevOps practices. • Basic knowledge of Confluence, Jira, Grafana, Secret Manager, and Argo. Nice to Have: • Experience with Argo workflows. • Familiarity with DevOps tools and methodologies. • Knowledge of data visualization tools.