Data Engineer
⚲ Warszawa, Gdańsk, Olsztyn, Białystok, Łódź, Poznań, Kraków, Wrocław, Lublin, Szczecin
22 680 - 24 360 PLN netto (B2B)
Wymagania
- Data
- SQL
- REST API
- GCP
- Kubernetes
- Terraform
- CI/CD
Opis stanowiska
This role is focused on the development and lifecycle management of a specialized, enterprise-grade laboratory and assay data platform. The platform's primary goal is to operationalize and deliver advanced data products associated with analytical, chemical, or biological assays.
As a Cloud Data Engineer, you will join the team responsible for implementing and supporting data products built on top of this platform, which includes building the underlying pipelines and transformations required for stable data delivery. You will work closely with cross-functional product and engineering teams to deploy new features, ensuring strict adherence to strict enterprise cloud security and engineering standards.
Key Responsibilities:
•
Implementation & Delivery: Build and support data products utilizing the internal assay data platform, managing data pipelines and transformations necessary for delivering domain-specific data assets.
• Post-Production Support: Provide engineering support for production data products, resolving technical issues and defects raised via ticketing tools in alignment with agreed business priorities.
• Feature Engineering: Develop and deliver new features, components, and enhancements based on requirements provided by product teams, ensuring robust and high-performing solutions.
• Cloud & Security Management: Maintain infrastructure as code and secure data boundaries within a highly regulated, enterprise cloud network.
Requirements & Qualifications:
• 5+ years of professional experience as a Data Engineer, Cloud Data Engineer, or a related role.
• Strong proficiency in Python and advanced SQL development.
• Hands-on experience building robust ETL/ELT workflows and interacting with REST APIs.
• Solid expertise in Google Cloud Platform (GCP), specifically focusing on BigQuery (BQ), Dataproc, and GKE (Google Kubernetes Engine).
• Proven production experience with Infrastructure as Code using Terraform.
• Strong familiarity with enterprise cloud security concepts, specifically IAM and VPC-SC (VPC Service Controls).
• Experience setting up automation and CI/CD pipelines using GitHub Actions.
• Familiarity with Agile methodologies and collaborative workflows.
• Strong communication and interpersonal skills with fluent English (C1 level minimum) and Polish min. B2
As a Cloud Data Engineer, you will join the team responsible for implementing and supporting data products built on top of this platform, which includes building the underlying pipelines and transformations required for stable data delivery. You will work closely with cross-functional product and engineering teams to deploy new features, ensuring strict adherence to strict enterprise cloud security and engineering standards.
Key Responsibilities:
•
Implementation & Delivery: Build and support data products utilizing the internal assay data platform, managing data pipelines and transformations necessary for delivering domain-specific data assets.
• Post-Production Support: Provide engineering support for production data products, resolving technical issues and defects raised via ticketing tools in alignment with agreed business priorities.
• Feature Engineering: Develop and deliver new features, components, and enhancements based on requirements provided by product teams, ensuring robust and high-performing solutions.
• Cloud & Security Management: Maintain infrastructure as code and secure data boundaries within a highly regulated, enterprise cloud network.
Requirements & Qualifications:
• 5+ years of professional experience as a Data Engineer, Cloud Data Engineer, or a related role.
• Strong proficiency in Python and advanced SQL development.
• Hands-on experience building robust ETL/ELT workflows and interacting with REST APIs.
• Solid expertise in Google Cloud Platform (GCP), specifically focusing on BigQuery (BQ), Dataproc, and GKE (Google Kubernetes Engine).
• Proven production experience with Infrastructure as Code using Terraform.
• Strong familiarity with enterprise cloud security concepts, specifically IAM and VPC-SC (VPC Service Controls).
• Experience setting up automation and CI/CD pipelines using GitHub Actions.
• Familiarity with Agile methodologies and collaborative workflows.
• Strong communication and interpersonal skills with fluent English (C1 level minimum) and Polish min. B2
🔍 Dekoder Ogłoszenia
🔴
enterprise-grade laboratory and assay data platform
Platforma jest prawdopodobnie złożona, z wieloma zależnościami i specyficznymi dla branży rozwiązaniami, co może oznaczać długi czas wdrożenia i naukę.
🔴
operationalize and deliver advanced data products
Może oznaczać, że praca będzie polegać na przekształcaniu istniejących danych w gotowe do użycia produkty, a nie na tworzeniu od podstaw innowacyjnych rozwiązań.
🔴
strict adherence to strict enterprise cloud security and engineering standards
Oznacza to, że procesy będą prawdopodobnie bardzo sformalizowane, z dużą ilością dokumentacji i procedur, co może spowolnić rozwój.
🔴
Post-Production Support
Duża część pracy może polegać na rozwiązywaniu problemów i błędów w istniejących systemach, zamiast na tworzeniu nowych funkcjonalności.
🔴
highly regulated, enterprise cloud network
Praca w środowisku z silnymi regulacjami może oznaczać dodatkowe ograniczenia i wymogi dotyczące bezpieczeństwa oraz zgodności.