Java/Spark Big Data Developer
CORRECT CONTEXT SPÓŁKA Z OGRANICZONĄ ODPOWIEDZIALNOŚCIĄ
⚲ Wrocław
18 000–25 000 zł netto (+ VAT) / mies.
Wymagania
- Java
- Spark
- Apache Iceberg
- AWS
- Airflow
Opis stanowiska
Nasze wymagania:
Linux as a daily driver of operations
Good understanding of Spark internals and mechanics
Experience with Apache Iceberg (or similar)
Solid understanding of algorithms, data structures, and complexity analysis
Proven ability to debug JVM/Java (hopefully in Spark ecosystem)
Hands-on, proactive approach
O projekcie:
Correct Context is looking for a Java/Spark Big Data Developer for Comscore in Poland and around.
Develop and maintain Java-based and Spark-based Big Data processing pipelines, ensuring scalability and performance.
Taking care of high-volume (tens of billions of events daily), multi-tenant, and distributed data processing pipelines.
Zakres obowiązków:
Taking care of our high-volume (tens of billions of events daily), multi-tenant, and distributed data processing pipelines
Develop and maintain Java-based and Spark-based Big Data processing pipelines, ensuring scalability and performance
Work with distributed systems, contributing to the design and implementation of backend solutions
Collaborate with cross-functional teams to integrate different platforms and ensure smooth data flow
Troubleshoot and debug issues to improve overall system stability
Participate in code reviews and offer guidance on best practices
Debug java/aws/airflow pipelines
Help team to produce better solutions (teaching/code reviews/showing directions)
Design high efficient processing pipelines
Oferujemy:
Real big data projects, petabytes scale
An international team
A small, independent team working environment
Flexible work time
Fully remote or in-office work in Wroclaw, Poland
Linux as a daily driver of operations
Good understanding of Spark internals and mechanics
Experience with Apache Iceberg (or similar)
Solid understanding of algorithms, data structures, and complexity analysis
Proven ability to debug JVM/Java (hopefully in Spark ecosystem)
Hands-on, proactive approach
O projekcie:
Correct Context is looking for a Java/Spark Big Data Developer for Comscore in Poland and around.
Develop and maintain Java-based and Spark-based Big Data processing pipelines, ensuring scalability and performance.
Taking care of high-volume (tens of billions of events daily), multi-tenant, and distributed data processing pipelines.
Zakres obowiązków:
Taking care of our high-volume (tens of billions of events daily), multi-tenant, and distributed data processing pipelines
Develop and maintain Java-based and Spark-based Big Data processing pipelines, ensuring scalability and performance
Work with distributed systems, contributing to the design and implementation of backend solutions
Collaborate with cross-functional teams to integrate different platforms and ensure smooth data flow
Troubleshoot and debug issues to improve overall system stability
Participate in code reviews and offer guidance on best practices
Debug java/aws/airflow pipelines
Help team to produce better solutions (teaching/code reviews/showing directions)
Design high efficient processing pipelines
Oferujemy:
Real big data projects, petabytes scale
An international team
A small, independent team working environment
Flexible work time
Fully remote or in-office work in Wroclaw, Poland
🔍 Dekoder Ogłoszenia
🔴
Linux as a daily driver of operations
Oczekuje się, że będziesz używać Linuksa nie tylko do pracy, ale także jako swojego głównego systemu operacyjnego na co dzień.
🔴
Good understanding of Spark internals and mechanics
Nie wystarczy podstawowa znajomość Sparka, oczekuje się głębokiego zrozumienia jego wewnętrznego działania.
🔴
Proven ability to debug JVM/Java (hopefully in Spark ecosystem)
Oczekuje się, że będziesz potrafił samodzielnie rozwiązywać problemy w kodzie Javy, najlepiej w kontekście Sparka.
🟡
Hands-on, proactive approach
Oczekuje się, że będziesz aktywnie szukać rozwiązań i podejmować inicjatywę, a nie tylko wykonywać polecenia.
🟢
Help team to produce better solutions (teaching/code reviews/showing directions)
Oczekuje się, że będziesz aktywnie dzielić się wiedzą i doświadczeniem, aby podnosić kompetencje całego zespołu.