Big Data Developer to Backend Application Team
emagine Polska
⚲ Warszawa
160 - 170 PLN/h netto (B2B)
Wymagania
- CI/CD
- Shell Scripting
- Apache Hadoop
- SQL
- Scala
- Apache Spark
Opis stanowiska
PROJECT INFORMATION: • Industry: Banking • Work model: 3/week in the office in Warsaw, Łódź, Gdańsk or Gdynia • Remuneration: up to 170 PLN/h netto + VAT (B2B) Summary The primary objective of this role is to bring significant technical expertise in Hadoop and Big Data technologies, contributing to backend application development. The Senior Hadoop / Big Data Developer will enhance the capabilities of the IT/Technology cluster while supporting key projects and initiatives that add value to the organization. Main Responsibilities: • Develop and maintain scalable data processing frameworks using Hadoop and Spark. • Implement functional programming techniques using Scala. • Work collaboratively within the Backend Application capability team to deliver high-quality software solutions. • Participate in SAFe framework practices for project management. • Optimize SQL queries for performance and efficiency. • Utilize version control and CI/CD tools for software deployment. Key Requirements: • 5+ years of experience with Scala. • Proficient in functional programming techniques and principles (Scala). • Experience working with Apache Spark. • Knowledge of Linux Shell Scripting. • Proficiency in SQL. • In-depth knowledge of the Hadoop stack, including YARN, Sqoop, Hive, Impala, MapReduce, and Oozie. • Familiarity with version control and CI/CD tools (Git, Ansible, Bamboo, Jenkins). Nice to Have: • Experience with Java. • Familiarity with streaming technologies such as Flink and Kafka. • Basic understanding of data analysis practices. • Experience with SAFe Agile methodologies.