Lead Data Platform Enginee
⚲ Bulgaria, Romania, Poland
Do uzgodnienia
Wymagania
- GCP
- PySpark
- Apache Spark
- Apache Airflow
- ArgoCD
- crossplane
- Terraform
- CI/CD
Opis stanowiska
💡 Lead Data Platform Engineer
•
B2B contract
•
Location: Romania / Bulgaria / Poland – 100% Remote
• Polish is a must
About the Client
A large-scale e-commerce marketplace operating in Central and Eastern Europe, serving millions of users. The company runs a highly distributed, cloud-native technology stack and processes high traffic and transaction volumes. Engineering teams focus on scalability, reliability, and automation, with strong emphasis on platform engineering, data-driven decision making, and continuous delivery in a fast-growing product environment.
Project Description
Development and evolution of a cloud-native Data Platform running on GCP, focused on improving developer experience, standardization, automation, and self-service capabilities for Data Analytics, Data Engineering, and Machine Learning teams. The role involves designing and implementing platform engineering solutions that simplify the lifecycle of Data Products, enable GitOps-based delivery processes, and accelerate adoption of GenAI-powered workflows across the organization.
Responsibilities:
•
Design and develop tools that standardize, automate, and simplify Data Platform operations.
• Build and maintain internal CLI tools for common platform and Data Product management tasks.
• Develop and evolve Data Product templates based on modern data engineering practices.
• Design and implement visualizations and operational insights within Backstage.
• Collect and analyze platform usage metrics, audit data, and adoption statistics.
• Design and implement Agentic AI workflows and developer-assistance capabilities.
• Develop reusable AI skills and automation components that standardize work with data products and data assets.
• Create mechanisms for distribution, lifecycle management, and monitoring of AI skills.
• Maintain and enhance a shared Apache Airflow platform based on Cloud Composer.
• Build reusable libraries, operators, and common components for Airflow DAG development.
• Develop and maintain infrastructure-as-code assets and Terraform modules.
• Contribute to GitOps adoption initiatives using tools such as Backstage, GitHub, ArgoCD, and Crossplane.
• Collaborate with platform, data engineering, analytics, and machine learning teams to improve platform usability and engineering efficiency.
Project Domain
e-commerce
Work model
Remote
Technical Requirements (must have)
• Strong commercial experience with Python development.
• Hands-on experience with Google Cloud Platform (GCP).
• Practical experience with BigQuery and cloud-based data platforms.
• Experience with Apache Airflow, preferably Cloud Composer.
• Experience building platform engineering, developer tooling, or internal self-service solutions.
• Knowledge of Infrastructure as Code practices and Terraform.
• Experience with GitOps principles and modern software delivery practices.
• Good understanding of data engineering concepts and Data Product lifecycle management.
• Experience with PySpark and/or Apache Spark ecosystems.
• Familiarity with FastAPI, Pydantic, and modern Python tooling.
• Knowledge of CI/CD processes and source control best practices.
• Experience working in Agile development environments.
• Strong problem-solving skills and ability to work independently.
• Effective communication skills and ability to collaborate with cross-functional teams.
•
Professional proficiency in Polish and English.
Nice-to-have
• Experience with Vertex AI or other GenAI platforms.
• Hands-on experience with GitHub Copilot, Copilot extensions, plugins, or AI-assisted development solutions.
• Experience developing Agentic AI workflows or AI automation capabilities.
• Knowledge of Backstage plugin development.
• Experience with Dataproc.
• Familiarity with dbt and Kedro.
• Experience with ArgoCD and Crossplane.
• Experience building observability, telemetry, or platform analytics solutions.
• Experience working in large-scale data environments supporting analytics and machine learning workloads.
Benefits ✅
• Stable long-term cooperation with opportunity for extension
• Opportunity to work with modern technologies in an international environment
•
Professional growth and continuous development opportunities
• Participation in challenging and impactful projects
📩 If you’re interested and meet the qualifications, please send your CV at alina.pchelnikova@dcvtechnologies.co.uk
•
B2B contract
•
Location: Romania / Bulgaria / Poland – 100% Remote
• Polish is a must
About the Client
A large-scale e-commerce marketplace operating in Central and Eastern Europe, serving millions of users. The company runs a highly distributed, cloud-native technology stack and processes high traffic and transaction volumes. Engineering teams focus on scalability, reliability, and automation, with strong emphasis on platform engineering, data-driven decision making, and continuous delivery in a fast-growing product environment.
Project Description
Development and evolution of a cloud-native Data Platform running on GCP, focused on improving developer experience, standardization, automation, and self-service capabilities for Data Analytics, Data Engineering, and Machine Learning teams. The role involves designing and implementing platform engineering solutions that simplify the lifecycle of Data Products, enable GitOps-based delivery processes, and accelerate adoption of GenAI-powered workflows across the organization.
Responsibilities:
•
Design and develop tools that standardize, automate, and simplify Data Platform operations.
• Build and maintain internal CLI tools for common platform and Data Product management tasks.
• Develop and evolve Data Product templates based on modern data engineering practices.
• Design and implement visualizations and operational insights within Backstage.
• Collect and analyze platform usage metrics, audit data, and adoption statistics.
• Design and implement Agentic AI workflows and developer-assistance capabilities.
• Develop reusable AI skills and automation components that standardize work with data products and data assets.
• Create mechanisms for distribution, lifecycle management, and monitoring of AI skills.
• Maintain and enhance a shared Apache Airflow platform based on Cloud Composer.
• Build reusable libraries, operators, and common components for Airflow DAG development.
• Develop and maintain infrastructure-as-code assets and Terraform modules.
• Contribute to GitOps adoption initiatives using tools such as Backstage, GitHub, ArgoCD, and Crossplane.
• Collaborate with platform, data engineering, analytics, and machine learning teams to improve platform usability and engineering efficiency.
Project Domain
e-commerce
Work model
Remote
Technical Requirements (must have)
• Strong commercial experience with Python development.
• Hands-on experience with Google Cloud Platform (GCP).
• Practical experience with BigQuery and cloud-based data platforms.
• Experience with Apache Airflow, preferably Cloud Composer.
• Experience building platform engineering, developer tooling, or internal self-service solutions.
• Knowledge of Infrastructure as Code practices and Terraform.
• Experience with GitOps principles and modern software delivery practices.
• Good understanding of data engineering concepts and Data Product lifecycle management.
• Experience with PySpark and/or Apache Spark ecosystems.
• Familiarity with FastAPI, Pydantic, and modern Python tooling.
• Knowledge of CI/CD processes and source control best practices.
• Experience working in Agile development environments.
• Strong problem-solving skills and ability to work independently.
• Effective communication skills and ability to collaborate with cross-functional teams.
•
Professional proficiency in Polish and English.
Nice-to-have
• Experience with Vertex AI or other GenAI platforms.
• Hands-on experience with GitHub Copilot, Copilot extensions, plugins, or AI-assisted development solutions.
• Experience developing Agentic AI workflows or AI automation capabilities.
• Knowledge of Backstage plugin development.
• Experience with Dataproc.
• Familiarity with dbt and Kedro.
• Experience with ArgoCD and Crossplane.
• Experience building observability, telemetry, or platform analytics solutions.
• Experience working in large-scale data environments supporting analytics and machine learning workloads.
Benefits ✅
• Stable long-term cooperation with opportunity for extension
• Opportunity to work with modern technologies in an international environment
•
Professional growth and continuous development opportunities
• Participation in challenging and impactful projects
📩 If you’re interested and meet the qualifications, please send your CV at alina.pchelnikova@dcvtechnologies.co.uk
🔍 Dekoder Ogłoszenia
🔴
fast-growing product environment
Często w praktyce oznacza szybko rosnące wymagania, zmieniające się priorytety i presję czasu.
🟡
high traffic and transaction volumes
Sygnał o wysokiej odpowiedzialności i potencjalnych dyżurach/on-call przy awariach.
🟡
Polish is a must
Wymóg językowy przy jednoczesnym 100% remote i międzynarodowym zespole — warto dopytać, dlaczego jest konieczny.
🟢
improving developer experience, standardization, automation, and self-service capabilities
Konkretny zakres — dobrze opisane oczekiwania, bez marketingowego lania wody.