Expert Data Engineer (IT Developer)

Your responsibilities • Design and build high-performance, distributed Big Data pipelines • Process, transform, and enrich large-scale datasets using Apache Spark • Develop solutions supporting data analytics, reporting, and business decision-making • Collaborate with data analysts and business stakeholders to build data models • Maintain and develop solutions based on Hadoop and Big Data technologies • Automate data processing workflows • Work closely with QA and other technical teams Requirements • Strong knowledge of Scala and Apache Spark • Experience working with Python • Hands-on experience with the Hadoop ecosystem: YARN, EMR, Sqoop, Hive, Oozie • Strong knowledge of SQL • Practical experience with Linux systems • Experience working with AWS cloud • Good command of English (working in an international environment) Nice to have • Experience in migrating data from on-premise to cloud environments • Experience working in Agile / SAFe frameworks • Experience handling large-scale data and near real-time processing systems About the project You will join a team developing a central data platform for a large enterprise. The project includes: • Building and developing distributed Big Data processing systems • Migrating solutions to public cloud (AWS) • Creating components supporting advanced analytics and data visualization • Working in a SAFe environment with regular PI Planning sessions What we offer • Participation in large-scale projects with real business impact • Work with a modern technology stack (Scala, Spark, Python, AWS, Hadoop) • Opportunity to take part in a cloud transformation of a large organization • Flexible hybrid work model (approx. 1 day per week in the office) • Occasional team meetings in Tricity (PI Planning) Additional information • Work model: hybrid (1 day per week in the office) • Office locations: Tricity / Warsaw / Łódź