Senior Data Engineer

Location: 100% remote work  Responsibilities: •    Building a distributed and highly parallelized Big Data processing pipeline to process massive amounts of data (both structured and unstructured) in near real-time •    Leveraging Spark & Scala to transform corporate data and enable data products to be built •    Ensuring continuous delivery on Hadoop and other Big Data platforms •    Automating processes where possible to ensure they are repeatable and reliable •    Creating and maintaining efficient data flows •    Collaborating with team members and stakeholders to deliver expected results Requirements: •    Minimum 5 years of experience with Spark & Scala •    Minimum 7 years of experience with Python •    Minimum 5 years of experience with Linux •    Hands-on experience with distributed data processing engines (e.g. Spark) •    Experience with Hadoop ecosystem tools (Hive, Oozie, MapReduce, etc.) •    Strong to advanced SQL skills •    Experience with version control systems: Bitbucket and Git •    Unit testing experience (JUnit 5, Mockito, Spark testing) •    Advanced English skills •    Strong collaboration and communication skills •    High level of self-motivation •    Curiosity, responsiveness, and ability to understand business and technical needs •    Focus on quality and continuous improvement Our offer: •    MultiSport Plus •    Group insurance •    Medicover Premium •    e-learning platform