NoFluffJobs Praca zdalna Senior New

Senior Data Architect – Ingestion & Integration (Azure)

AVENGA (Agencja Pracy, nr KRAZ: 8448)

⚲ Wrocław

32 000 - 36 000 PLN (B2B)

Wymagania

  • Microsoft Azure
  • Security
  • Enterprise Architect
  • BI
  • Azure Databricks
  • Azure Data Factory
  • ETL
  • Data modelling
  • Data structures
  • OAuth
  • AD
  • Vault
  • Message queue
  • Kafka
  • IBM
  • IBM MQ
  • Azure Event Hub
  • Python
  • Spark
  • Scala
  • SQL
  • dbt
  • Azure

Opis stanowiska

O projekcie: We are looking for a Senior Data Architect with strong expertise in data ingestion and integration on Microsoft Azure. In this role, you will design and govern ingestion architectures, define standards and patterns, and act as the reference expert for ingestion and replication on our Data Platform. You will work closely with data engineers, architects, and business stakeholders in a global environment. This role is based in Wrocław, Poland. Wymagania: Required Competencies General • Proven experience in data ingestion and/or data integration, ideally in a Data Architect or Lead Engineer role. • Strong understanding of data platforms and ingestion/replication patterns; awareness of market trends in these areas is a plus. • Demonstrated learning and growth mindset, with a strong focus on innovation. • Experience working with integration architectures across diverse ecosystems. • Experience working in a global, distributed context. • Ability to work with and coordinate 3rd party vendors and external resources. • Ability to act as a lead developer/technical lead when required. Technical Skills • Full understanding of Medallion architecture (Bronze/Silver/Gold layers) and its application to modern data platforms. • Deep experience with cloud-based data architectures and DW/BI/Analytics, particularly on Microsoft Azure, including: - Azure Data Factory (ADF) - Azure Event Hub (AEH) - Azure Databricks - Azure Storage - Azure Functions • Strong understanding of ETL/ELT concepts, streaming, and event-driven data pipelines. • Exposure to data modelling and data transformation concepts to ensure consistent, reusable data structures post ingestion. • Expertise in security, authentication, and access control in Azure: - Managed Identities (MI) / Service Principals - OAuth 2.0 - Azure AD group nesting - Azure Key Vault integration • Experience with message queues and integration technologies (e.g. Kafka, IBM MQ, Azure Event Hub, Confluent) is preferred. • Experience defining ingestion SLAs, optimizing throughput, and establishing monitoring and observability strategies. • Hands-on experience in data ingestion, transformation, and historization using: - Python - Spark - Scala - SQL • Experience implementing and working with data modelling tools such as dbt. Codzienne zadania: - Design and govern data ingestion patterns using the appropriate Azure platforms, services, methods, and guidelines. - Participate in technology selection and define standards for ingestion and integration solutions. - Contribute to core Data Platform architecture, especially ingestion, replication, and medallion-layer design (Bronze/Silver/Gold). - Lead or support Proofs of Concept (PoCs) for Data Ingestion & Replication, validating approaches and tools. - Ensure consistent use of shared technical standards, tools, and platforms across teams. - Ensure alignment with Volvo Group Security directives and customer information security requirements. - Align ingestion and replication architecture with Enterprise Architecture (EA) principles and guidelines. - Translate business and data requirements into target data architectures and document them with appropriate architecture and design artifacts. - Initiate, drive, and support continuous improvement activities for data ingestion and replication capabilities. - Support the Data Replication & Ingestion Manager in assessing technical skills and act as a mentor and coach for team members. - Be the go-to expert for ingestion technologies and related architectural topics. - Contribute to the roadmap for Ingestion Platform capabilities and ensure alignment with the overall data strategy. - Collaborate closely with ingestion specialists and data engineers to ensure robust, scalable, and secure solutions.