Senior Data Engineer – Hadoop & Spark Leadership
⚲ Krakow
26 040 - 31 500 PLN netto (B2B)
Wymagania
- DATA MODELLING
- agile methodologies
- CI/CD pipelines
- Splunk
- NoSQL
- Hadoop
- Apache Spark
- ETL/ELT pipelines
- SQL
- Python
Opis stanowiska
Ignite Data Innovation — Lead with Impact in Data Engineering Excellence!
Krakow-based opportunity with hybrid work model (up to 3 remote days per week).
As a Senior Data Engineer – Hadoop & Spark Leadership, you will be working for our client, a leading financial institution, driving complex data engineering projects. Your expertise will empower the organization to harness big data for strategic insights, fostering innovation and operational efficiency.
Your main responsibilities:
• Lead the design and delivery of scalable data engineering solutions leveraging Hadoop, Spark, and Splunk.
• Build and optimise ETL/ELT data pipelines in Python, ensuring robust data ingestion, transformation, and integration.
• Handle raw, structured, semi-structured, and unstructured data (SQL and NoSQL) within diverse environments.
• Manage the full data lifecycle, from ingestion to transformation, while implementing source control and CI/CD pipelines.
• Collaborate closely with BI and Analytics teams in fast-paced, dynamic settings.
• Provide technical leadership, mentoring junior engineers, and leading innovative projects.
• Ensure high data quality through comprehensive unit and integration testing, supporting continuous integration processes.
• Maintain service resilience, sustainability, and adherence to governance principles, emphasizing risk management and compliance.
You're ideal for this role if you have:
• At least 5 years of experience in enterprise data engineering, with a focus on Hadoop, Spark, and Splunk.
• Strong proficiency in data modelling and building efficient ETL/ELT pipelines using Python.
• Demonstrated experience handling structured, semi-structured, and unstructured data.
• Familiarity with CI/CD pipelines and source control management.
• Proven technical leadership and mentoring skills.
• Excellent stakeholder management and communication skills.
• Strong understanding of risk management and governance principles in data projects.
It is a strong plus if you have:
• Experience with agile methodologies such as Scrum or Kanban.
• Knowledge of industry groups and external vendor collaborations.
Language Required for the role:
• English — Communicative level.
Eligibility for the role:
• Only candidates with an existing legal right to work in the European Union will be considered for this role.
#MAKEYourCareerBETTER
Interested? Apply now and include your CV (preferably in English) along with a statement confirming your consent to the processing and storage of your personal data.
Krakow-based opportunity with hybrid work model (up to 3 remote days per week).
As a Senior Data Engineer – Hadoop & Spark Leadership, you will be working for our client, a leading financial institution, driving complex data engineering projects. Your expertise will empower the organization to harness big data for strategic insights, fostering innovation and operational efficiency.
Your main responsibilities:
• Lead the design and delivery of scalable data engineering solutions leveraging Hadoop, Spark, and Splunk.
• Build and optimise ETL/ELT data pipelines in Python, ensuring robust data ingestion, transformation, and integration.
• Handle raw, structured, semi-structured, and unstructured data (SQL and NoSQL) within diverse environments.
• Manage the full data lifecycle, from ingestion to transformation, while implementing source control and CI/CD pipelines.
• Collaborate closely with BI and Analytics teams in fast-paced, dynamic settings.
• Provide technical leadership, mentoring junior engineers, and leading innovative projects.
• Ensure high data quality through comprehensive unit and integration testing, supporting continuous integration processes.
• Maintain service resilience, sustainability, and adherence to governance principles, emphasizing risk management and compliance.
You're ideal for this role if you have:
• At least 5 years of experience in enterprise data engineering, with a focus on Hadoop, Spark, and Splunk.
• Strong proficiency in data modelling and building efficient ETL/ELT pipelines using Python.
• Demonstrated experience handling structured, semi-structured, and unstructured data.
• Familiarity with CI/CD pipelines and source control management.
• Proven technical leadership and mentoring skills.
• Excellent stakeholder management and communication skills.
• Strong understanding of risk management and governance principles in data projects.
It is a strong plus if you have:
• Experience with agile methodologies such as Scrum or Kanban.
• Knowledge of industry groups and external vendor collaborations.
Language Required for the role:
• English — Communicative level.
Eligibility for the role:
• Only candidates with an existing legal right to work in the European Union will be considered for this role.
#MAKEYourCareerBETTER
Interested? Apply now and include your CV (preferably in English) along with a statement confirming your consent to the processing and storage of your personal data.
🔍 Dekoder Ogłoszenia
🔴
Lead with Impact in Data Engineering Excellence!
To marketingowy slogan, który podkreśla znaczenie roli, ale nie daje konkretnych informacji o zakresie obowiązków czy oczekiwaniach.
🔴
driving complex data engineering projects
Może oznaczać zarówno ciekawe, ambitne projekty, jak i projekty z problemami, które wymagają dużo czasu i wysiłku do rozwiązania.
🔴
fostering innovation
Może oznaczać realne możliwości wprowadzania nowych rozwiązań, ale też może być pustym hasłem bez konkretnych narzędzi czy budżetu na innowacje.
🔴
fast-paced, dynamic settings
Sugeruje szybkie tempo pracy i częste zmiany priorytetów, co może być ekscytujące, ale też stresujące.
🟡
technical leadership, mentoring junior engineers
Oprócz zadań technicznych, będziesz odpowiedzialny za rozwój i wsparcie mniej doświadczonych członków zespołu.