Senior Flink Developer

O projekcie: Pharmaceutical Client: Developed cloud-based data platforms to support research and analytics in life sciences. Implemented robust ETL processes and data modeling to facilitate data-driven decisions in clinical and operational domains. The person is expected to join the global identity and access management team for a customer that is one of the biggest pharmaceutical companies in Europe. The candidate is expected to work really independently with some guardrails. There are people from our company in the team that there will be a close collaboration with. The project aims to detect threats in the area of security. We analyze logs and identify abnormal patterns based on login activity. Detections are built using streaming technologies — primarily Flink. Most of the logic is implemented in Flink SQL, but critical components are written using the Datastream API (Java). There are many proof-of-concepts — we evaluate technologies (e.g., different databases for our use cases). As part of the work, a platform was created for managing and developing Flink SQL jobs, which we continuously improve. Additionally, we have the opportunity to contribute to open-source projects. Wymagania: Technologies required: - Flink SQL, Flink (Java), pyFlink (occasionally)- Kafka- Kubernetes, Flink Kubernetes operator Nice to have: - AWS- Temporal- Spring boot, Spring batch- Redis- Noe4j- Postgres- Grafana, Prometheus- ELK Codzienne zadania: - Design and implement new functionality - Maintain and troubleshoot the solution - Performance and reliability tuning - Support other teams using the solution