Senior Data Engineer

Salary: 1200 - 1500 PLN/day on B2B Work model: hybrid from Gdańsk / Warsaw (1 day per week from the office)   Why choose this offer? • You can expect a flexible work organization • The international work environment will give you the opportunity to interact with the English language on a daily basis • Scandinavian organizational culture will provide you with work-life balance, you will gain time for additional training (financed by Jit) • The Jit community will bring you a nice time during regular integration meetings   Project Developer hired for this position will be working on implementing multiple data requirements coming from the Group Financial Crime Prevention unit in Nordea. Data requirements spans from developing streaming application that connect to multiple data sources both internally (Nordea internal sources) or externally (outside Nordea network) but also to enable advanced analytics pipeline that produces clean, transformed data set that are being utilized to feed multiple products within the Financial Crime sector. Responsibilities you'll have • Building distributed and highly parallelized BigData processing pipeline which process massive amount of data (both structured and unstructured) in near real-time • Leverage Spark to enrich and transform corporate data to enable searching, data visualization, and advanced analytics • Requirement analysis and questioning requirements when they are not clear • Work closely with DevOps, QA and Product Management teams in a Continuous Delivery environment • This is a cross functional role between QA and Dev capabilities, where test driven approach will be the key in implementing the solution. • That will include, but not limit to the test case & test data preparation, test automations scripts implementation in Robot Framework and Python, test planning and test execution ( test results analysis and defect reporting), ect. • As a cross functional developer, you will work closely with DevOps, QA and Product Management teams in a Continuous Delivery environment Must-have knowledge and experience to succeed in this role, we believe that you: • Experience with distributed data processing engines like Spark • Are collaborative and achieve your expectations through communication and teamwork in Agile setup (SAFe Framework) • Are curious, responsive and can understand the needs of others to ensure delivery of the desired results • Work qualitatively and strive to always do things better • Have a high level of self-motivation Expected competences and knowledge • Experience with distributed data processing engines like Spark • Experience with Hadoop and (Hive, Oozie, map reduce, ect) • Strong SQL skills with previous experience in creating data flows • BitBucket and GIT expert • AWS knowledge about architectural components ( Lamba, step functions, state machine, ect) • Unit testing Experience (Junit 5, Mockito, Spark testing) • Code versioning strategy & Branching strategy • Advanced English skills • Strong working experience with Linux and bash • Experience using following tools : Jenkins or Bamboo, Jira, bitbucket Nice-to-have knowledge and experience • Experience with containerization using Docker • Knowledge of streaming and queues technologies e.g. KAFKA, IBM MQ etc • Working knowledge of DevOps Technologies you'll work with • Spark • Hadoop • AWS • SQL   Client – why choose this particular client from the Jit portfolio? Jit Team has had an over-decade-long relationship with the leading financial group in the Nordic countries, and we are privileged to be our client's premier partner in Poland. At present, over 200 Jit personnel are engaged in the completion of more than 60 projects for this Norwegian major provider of financial services with a global presence and a strong focus on modern technology. Our customer's work atmosphere is epitomized by the Scandinavian culture, which is conducive to people who place emphasis on work-life balance and feedback culture. Furthermore, all projects are executed in international teams, giving constant exposure to the English language.    About Jit Team The Human Factor of IT - it’s not just a slogan, it’s a philosophy. The foundation of Jit Team is people, which is why we prioritise you. We employ over 770 experienced experts, to whom we offer developmental projects, a wide range of benefits, and a proprietary professional development programme. Together with clients from around the world, we create innovative IT solutions delivered by highly specialised and efficient teams.   Behind our maxim are also charitable and educational activities. We support schools, universities, and educational institutions by conducting workshops, running educational projects, sponsoring events, and donating learning equipment. We offer internships that help launch careers in IT. We support water rescuers and hospitals by providing the necessary equipment. We also support numerous charitable organisations helping people in need, children, and the elderly. We are a Polish company and we share what we have achieved over more than 15 years of activity. By supporting local initiatives, we contribute to the circulation of good energy.