Big Data Developer
B2Bnetwork
⚲ Warszawa, Gdańsk, Łódź, Gdynia
140 - 175 PLN/h netto (B2B)
Wymagania
- Hadoop
- Scala
- Apache Spark
Opis stanowiska
About the Team Join the Backend Application Capability Team, where we support key projects and initiatives within GBS (Group Business Support) – IT/Technology. Our team focuses on delivering high-quality platform and software development solutions, enabling scalable and efficient data processing systems that support critical business operations.Key Responsibilities • Design and develop Big Data solutions using Scala and Apache Spark • Contribute to the development and maintenance of data platforms within the Hadoop ecosystem • Write, optimize, and maintain SQL queries for data processing and analysis • Develop and maintain automation scripts using Linux Shell Scripting • Collaborate with cross-functional teams to integrate, deploy, and maintain data solutions • Work with version control systems and CI/CD tools to support efficient development and deployment processes • Participate in designing scalable data pipelines and data processing architectures Required Qualifications • 3+ years of professional experience with Scala • Practical experience working with Apache Spark • Knowledge of Linux Shell Scripting • Strong knowledge of SQL • Experience with the Hadoop ecosystem (YARN, Sqoop, Hive, Impala, MapReduce, Oozie, etc.) • Familiarity with version control and CI/CD tools (e.g., Git, Ansible, Bamboo, Jenkins) Nice to Have • Experience with functional programming concepts and principles in Scala • Experience with streaming technologies such as Flink or Kafka • Basic understanding of data analysis • Familiarity with SAFe Agile methodology