Data Engineer Scala/Spark
⚲ Gdańsk
27 000 - 32 000 PLN netto (B2B)
Wymagania
- Scala
- Spark
- Databricks
Opis stanowiska
At DAC.digital, we are continuously expanding our business and strengthening our position in the market. As part of our growth strategy, we are launching a strategic partnership with one of the world’s leading providers of financial market infrastructure.
Key information:
Salary: 27 000 - 32 000 PLN net/month - pure B2B contract23 500 – 28 000 PLN net/month – B2B contract (days off included)
You will be responsible for supporting our team in:
• designing, developing, and maintaining scalable data processing solutions using Scala and Apache Spark;
• building and optimizing data pipelines and ETL workflows in cloud-based environments on Google Cloud Platform (GCP);
• developing and maintaining data engineering solutions using Databricks and Zeppelin Notebooks;
• writing, optimizing, and troubleshooting complex SQL queries to support business and analytical requirements;
• orchestrating, scheduling, and monitoring data workflows using Apache Airflow;
• ensuring data quality, reliability, and performance across data platforms and processing pipelines;
• collaborating with cross-functional teams to gather requirements and deliver data-driven solutions;
• participating in code reviews, testing, and continuous improvement of data engineering best practices;
• documenting technical solutions and project deliverables in Confluence;
• supporting agile delivery processes through effective use of Jira for task management and collaboration.
Technology stack:
• Scala
• Spark
• GCP
• SQL
• Databricks
• Zeppelin Notebooks
• Airflow
• Jira
• Confluence
Nice to have technologies:
• Oracle
• Informatica (just to analyse the current System and Workflows, you don’t need to develop any new pipelines)
It is vital that you have:
• strong experience with Scala and Apache Spark for designing and developing distributed data processing solutions;
• hands-on experience with Databricks and Zeppelin Notebooks in data engineering and analytics projects;
• proficiency in leveraging Google Cloud Platform (GCP) services for scalable cloud-based data solutions;
• advanced SQL knowledge for complex querying, data modeling, and performance tuning;
• experience in building, scheduling, and monitoring ETL pipelines using Apache Airflow;
• practical knowledge of Jira and Confluence for agile delivery, project tracking, and documentation management;
• knowledge of English (min. B2);
• working in agile methodologies (Scrum, Kanban);
• high communication skills;
• eager to learn and share knowledge.
What do we offer:
• possibility to work 100% remotely or on-site at our office in Gdańsk;
• b2b contract with included 30 days off;
• private Medical care;
• group insurance;
• pre-paid card or Sport Card;
• referral program;
• real Agile practices;
• employee well-being online platform;
• cafeteria benefits.
Key information:
Salary: 27 000 - 32 000 PLN net/month - pure B2B contract23 500 – 28 000 PLN net/month – B2B contract (days off included)
You will be responsible for supporting our team in:
• designing, developing, and maintaining scalable data processing solutions using Scala and Apache Spark;
• building and optimizing data pipelines and ETL workflows in cloud-based environments on Google Cloud Platform (GCP);
• developing and maintaining data engineering solutions using Databricks and Zeppelin Notebooks;
• writing, optimizing, and troubleshooting complex SQL queries to support business and analytical requirements;
• orchestrating, scheduling, and monitoring data workflows using Apache Airflow;
• ensuring data quality, reliability, and performance across data platforms and processing pipelines;
• collaborating with cross-functional teams to gather requirements and deliver data-driven solutions;
• participating in code reviews, testing, and continuous improvement of data engineering best practices;
• documenting technical solutions and project deliverables in Confluence;
• supporting agile delivery processes through effective use of Jira for task management and collaboration.
Technology stack:
• Scala
• Spark
• GCP
• SQL
• Databricks
• Zeppelin Notebooks
• Airflow
• Jira
• Confluence
Nice to have technologies:
• Oracle
• Informatica (just to analyse the current System and Workflows, you don’t need to develop any new pipelines)
It is vital that you have:
• strong experience with Scala and Apache Spark for designing and developing distributed data processing solutions;
• hands-on experience with Databricks and Zeppelin Notebooks in data engineering and analytics projects;
• proficiency in leveraging Google Cloud Platform (GCP) services for scalable cloud-based data solutions;
• advanced SQL knowledge for complex querying, data modeling, and performance tuning;
• experience in building, scheduling, and monitoring ETL pipelines using Apache Airflow;
• practical knowledge of Jira and Confluence for agile delivery, project tracking, and documentation management;
• knowledge of English (min. B2);
• working in agile methodologies (Scrum, Kanban);
• high communication skills;
• eager to learn and share knowledge.
What do we offer:
• possibility to work 100% remotely or on-site at our office in Gdańsk;
• b2b contract with included 30 days off;
• private Medical care;
• group insurance;
• pre-paid card or Sport Card;
• referral program;
• real Agile practices;
• employee well-being online platform;
• cafeteria benefits.
🔍 Dekoder Ogłoszenia
🔴
continuously expanding our business and strengthening our position in the market
Firma się rozwija, co może oznaczać potrzebę szybkiego dostosowania się do nowych wyzwań i potencjalnie większą presję.
🟡
strategic partnership with one of the world’s leading providers of financial market infrastructure
Praca nad projektem dla klienta z branży finansowej, co może wiązać się z wysokimi wymaganiami dotyczącymi bezpieczeństwa i zgodności.
🔴
Salary: 27 000 - 32 000 PLN net/month - pure B2B contract
Podana kwota jest stawką netto na umowie B2B, co oznacza samodzielne rozliczanie podatków i składek.
🔴
23 500 – 28 000 PLN net/month – B2B contract (days off included)
Niższa stawka na B2B z uwzględnieniem dni wolnych, co może sugerować, że standardowa umowa B2B nie zawiera płatnych dni wolnych.
🟡
supporting our team in: designing, developing, and maintaining scalable data processing solutions
Oznacza, że będziesz częścią zespołu i będziesz wykonywać zadania związane z projektowaniem, tworzeniem i utrzymaniem istniejących rozwiązań, a niekoniecznie tworzyć je od zera.