NoFluffJobs Praca zdalna Senior

Data Engineer

AVENGA (Agencja Pracy, nr KRAZ: 8448)

⚲ Wrocław

27 720 - 31 920 PLN (B2B)

Wymagania

  • Python
  • Azure Databricks
  • Spark

Opis stanowiska

O projekcie: Key Responsibilities: - Design, develop, and optimize data pipelines and workflows using Azure Databricks and Python. - Implement and maintain data solutions across the Azure Data Platform (Data Lake, Databricks, etc.). - Develop and maintain APIs supporting data ingestion, data sharing, and interoperability. - Collaborate closely with business stakeholders to gather requirements and translate them into technical solutions. - Ensure data quality, security, and compliance across all solutions. - Integrate data solutions into existing business processes and cross-functional systems. - Continuously improve performance, cost-efficiency, and scalability of data systems. Wymagania: Required Skills & Qualifications: - Strong knowledge in IICS stack (Informatica Intelligent Cloud Services) - Strong expertise in Azure Databricks, Python, Spark. - Solid experience with Azure Data Services, such as: Azure Data Lake and Azure Data Factory - Experience in ingestion tools like: Qlik Recplicate / MQ / MQCC - Experience with API development (REST/JSON or equivalent). - Solid understanding of ETL processes, data modeling, and fundamental data architecture principles. - Familiarity with CI/CD pipelines and version control (Git, etc.).