Senior Data Engineer – Big Data & Cloud Technologies

Unleash the Power of Data — Shape the Future of Big Data & Cloud Innovation! Krakow-based opportunity with hybrid work model, allowing up to 3 days remote per week. As a Senior Data Engineer, you will be working for our client, a leading player in the data and analytics industry. You will contribute to designing and building scalable, high-performance data pipelines that drive business insights and innovation. This role offers a unique chance to be at the forefront of big data and cloud technologies, shaping meaningful solutions for global clients. Your main responsibilities: • Develop and optimize data pipelines using PySpark, Scala, and Hadoop components to support scalable analytics solutions. • Work with Apache Spark, Hive, YARN, and ETL frameworks to process large datasets efficiently. • Collaborate with Business Analysts to interpret requirements and translate them into technical solutions. • Implement and maintain automated testing, deployment, and monitoring tools to ensure system reliability. • Provide production support, troubleshoot issues, and improve performance and scalability. • Participate actively in Agile rituals, including sprint planning, reviews, and retrospectives. • Contribute to system architecture and design discussions, ensuring best practices and standards. You're ideal for this role if you have: • 4+ years of experience in data engineering or similar roles. • Strong proficiency in PySpark or Scala development and design. • Hands-on experience with scheduling tools such as Airflow. • Knowledge of Hadoop ecosystem components (Hive, Spark, Spark SQL, YARN). • Experience with SQL, RESTful services, and Unix/Linux environments. • Familiarity with version control (Git, GitHub), CI/CD tools (Jenkins, Ansible), and requirement management systems (JIRA). It is a strong plus if you have: (optional) • Experience with Elasticsearch. • Development experience with Java APIs. • Knowledge of data ingestion techniques. • Understanding of cloud design patterns. • Exposure to DevOps methodologies and Agile practices like Scrum and Kanban. Language Required for the role: • Fluent in English. Eligibility for the role: • Only candidates with an existing legal right to work in Europe will be considered for this role. #MAKEYourCareerBETTER Interested? Apply now and include your CV (preferably in English) along with a statement confirming your consent to the processing and storage of your personal data.