Data Engineer (Scala / Spark / Azure)
AXA IT Solutions
⚲ Warszawa
120 - 165 zł net (+ VAT)
Wymagania
- Scala
- Apache Spark
- Azure Data Factory
- Databricks
- CI/CD (nice to have)
Opis stanowiska
Wymagania: - Hands-on experience with Scala (at least one commercial or substantial project; expert level not required) - Experience working with Apache Spark - Familiarity with Databricks for data processing and development - Experience with Azure Data Factory (ADF) or similar orchestration tools - Understanding of data pipeline concepts, ETL/ELT processes, and data modeling basics - Proactive and communicative approach to work - Good command of English (written and spoken) is required - Ability to work with existing codebases and adapt to changing requirements Mile widziane: - Experience with Azure ecosystem components - Exposure to performance tuning in Spark - Familiarity with CI/CD practices in data engineering O firmie: - We are an internal software house operating within the international insurance group AXA. We provide IT solutions for the needs of AXA companies in Europe. We work in English on a daily basis, in close-knit teams, carrying out international development projects. Zakres obowiązków: - Implement new data structures by adding tables and columns based on provided specifications - Maintain and troubleshoot existing pipelines, including identifying and fixing bugs - Modify and enhance data transformations in response to evolving business requirements - Optimize data processing workflows to improve performance and efficiency - Collaborate with other team members to ensure data consistency and quality - Use Databricks notebooks for debugging, testing, and validating data processing logic Oferujemy: - Opportunity to work on scalable data processing systems in a cloud environment - Collaborative team focused on practical problem-solving and continuous improvement - Exposure to modern data engineering tools and architecture