JustJoin.IT Praca zdalna Senior New

Senior Flink Data Engineer

co.brick

⚲ Gliwice

170 - 180 PLN/h netto (B2B)

Wymagania

  • Apache Flink
  • Flink

Opis stanowiska

Join a global digital platform at a massive scale. This project is a high-impact initiative focused on the modernization of a large-scale streaming data platform. You will lead the evolution of Apache Flink pipelines, execute complex data migrations from BigQuery to Data Cloud Storage, and—most importantly—spearhead the platform upgrade to Flink 2.0. This is a mission-critical role requiring deep expertise in high-throughput, fault-tolerant architectures. Details   • Seniority: Mid+/Senior Developers. • Start Date: May 1, 2026. • Duration: Initial contract until Dec 31, 2026 • Rate: 170–180 PLN/h net + VAT (B2B). • Location: 100% Remote. Responsibilities • Streaming Excellence: Developing and enhancing real-time pipelines using Apache Flink and the DataStream API. • Platform Evolution: Leading the strategic upgrade of the Flink platform to version 2.0. • Massive Migration: Migrating large-scale datasets from BigQuery (BQ) to Data Cloud Storage (DCS). • Format Optimization: Converting datasets from Avro to Parquet, focusing on performance, schema evolution, and storage efficiency. • AI-Driven Workflows: Leveraging AI-powered tools to accelerate migration, validation, and transformation tasks. • Scale & Automation: Designing high-throughput architectures and automating migration processes to ensure minimal downtime. Requirements • Flink Mastery: Strong hands-on experience with Apache Flink, DataStream API, state management, and performance tuning. • Migration Expertise: Proven track record in large-scale data migrations (ideally BQ to DCS). • Data Formats: Deep understanding of Avro, Parquet, and schema evolution strategies. • Cloud Ecosystem: Solid knowledge of Google Cloud Platform (GCP) and distributed systems. • IaC & Automation: Ability to scale and automate complex migration workflows. Should-have & Nice-to-have • AI & ML: Practical experience using AI-based tools to optimize data workflows. • Observability: Familiarity with monitoring and alerting for high-scale streaming systems. • Background: Experience with long-running migration programs in consumer-facing platforms. Soft Skills • Ability to break down complex architectural challenges into actionable steps. • Strong ownership and "risk identification" mindset. • Excellent communication skills, especially when explaining technical migration paths to non-technical stakeholders.