JustJoin.IT
Hybrydowo
Senior
↻
Expert Data Engineer
B2Bnetwork
⚲ Warszawa, Gdańsk, Łódź
120 - 150 PLN/h netto (B2B)
Wymagania
- Spark SQL
- ETL
- Spark
- Hadoop
- Hive
- Python
- Scala
- Big Data
Opis stanowiska
· Building distributed and highly parallelized Big data processing pipeline which process massive amount of data (both structured and unstructured data) in near real-time · Leveraging Spark to enrich and transform corporate data to enable searching, data visualization, and advanced analytics · Working closely with analysts and business stakeholders to develop analytics models · Continuous delivering on Hadoop and other Big Data Platforms · Automating processes where possible and are repeatable and reliable · Working closely with QA team