Java/Spark Big Data Developer

O projekcie: Correct Context is looking for a Java/Spark Big Data Developer for Comscore in Poland and around. Comscore is a global leader in media analytics, revolutionizing insights into consumer behavior, media consumption, and digital engagement. Comscore leads in measuring and analyzing audiences across diverse digital platforms. Thrive on using cutting-edge technology, play a vital role as a trusted partner delivering accurate data to global businesses, and collaborate with industry leaders like Facebook, Disney, and Amazon. Contribute to empowering businesses in the digital era across media, advertising, e-commerce, and technology sectors. We offer: - Real big data projects, petabytes scale 🚀 - An international team 🌎 - A small, independent team working environment 🧑‍💻 - Flexible work time ⏰ - Fully remote or in-office work in Wroclaw, Poland 🏢 - 18,000 - 25,000 PLN net/month B2B 💰 - Multikafeteria 🍽️ - Private healthcare 🏥 - Free parking 🚗 The recruitment process for the Java Developer position has following steps: - Technical survey ~ 10min - Technical screening - 30 min - Technical interview - 1h-2h - Final Interview - 1h Wymagania: The candidate must have: - Linux as a daily driver of operations - Good understanding of Spark internals and mechanics - Experience with Apache Iceberg (or similar) - Proven ability to debug JVM/Java (hopefully in Spark ecosystem) - Hands-on, proactive approach If you think you’re a good fit, but don’t meet all the qualifications, let’s talk! Codzienne zadania: - Taking care of our high-volume (tens of billions of events daily), multi-tenant, and distributed data processing pipelines  - Develop and maintain Java-based and Spark-based Big Data processing pipelines, ensuring scalability and performance  - Work with distributed systems, contributing to the design and implementation of backend solutions  - Collaborate with cross-functional teams to integrate different platforms and ensure smooth data flow  - Troubleshoot and debug issues to improve overall system stability  - Participate in code reviews and offer guidance on best practices  - Debug java/aws/airflow pipelines  - Help team to produce better solutions (teaching/code reviews/showing directions)  - Design high efficient processing pipelines