NoFluffJobs Hybrydowo Senior New

Remote Architect (Data Ingestion)

Ework Group

⚲ Wroclaw, Gdynia, Łódź, Warszawa

30 240 - 35 280 PLN (B2B)

Wymagania

  • Microsoft Azure
  • ETL
  • Data structures
  • Python
  • Scala
  • Spark
  • SQL
  • Databricks
  • Data ingestion
  • Kafka
  • Azure Data Factory
  • Azure Storage
  • Azure Functions
  • Azure Event Hub
  • Data integration
  • Data Architecture
  • Medallion

Opis stanowiska

O projekcie: 💻 Ework Group - founded in 2000, listed on Nasdaq Stockholm, with around 13,000 independent professionals on assignment - we are the total talent solutions provider who partners with clients, in both the private and public sector, and professionals to create sustainable talent supply chains. With a focus on IT/OT, R&D, Engineering and Business Development, we deliver sustainable value through a holistic and independent approach to total talent management. By providing comprehensive talent solutions, combined with vast industry experience and excellence in execution, we form successful collaborations. We bridge clients and partners & professionals throughout the talent supply chain, for the benefit of individuals, organizations and society. 🔹 For our Client from automotive industry, we are looking for Data Architect - 100% remote with occassional visits at Wroclaw office once / quarter for Planning meetings🔹 - 70% architecture / 30% development.- The platform is mature and built around Azure and Databricks. We continuously develop it by adapting processes to current needs and further standardizing them.- The main challenges are process standardization and increasing use of AI. Additionally, the scale of the organization, as well as the diversity of data sources and data types, are key factors.- From a technical perspective, the most important skill is integrating data across different ecosystems within Azure and Databricks environments.What we offer: - B2B cooperation.- International environment.- Supportive working culture.- Private medical care, life insurance, Multisport, and team-building events.- Remote work possible, with location in Wrocław. Wymagania: - Proven experience in data ingestion and/or data integration, ideally in a Data Architect or Lead Engineer role.- Full understanding of Medallion architecture (Bronze/Silver/Gold layers) and its application to modern data platforms.- Deep experience with cloud-based data architectures and DW/BI/Analytics, particularly on Microsoft Azure- Strong understanding of ETL/ELT concepts, streaming, and event-driven data pipelines.- Exposure to data modelling and data transformation concepts to ensure consistent, reusable data structures post ingestion.- Expertise in security, authentication, and access control- Experience defining ingestion SLAs, optimizing throughput, and establishing monitoring and observability strategies.- Hands-on experience in data ingestion, transformation, and historization using: Python, Scala, Spark, SQL- Experience implementing and working with data modelling tools such as dbt.- Experience working with integration architectures across diverse ecosystems.- Experience working in a global, distributed context.- Ability to work with and coordinate 3rd party vendors and external resources.- Ability to act as a lead developer/technical lead when required. Codzienne zadania: - Design and govern data ingestion patterns on the Azure platform (services, methods, and guidelines). - 70% architecture / 30% development. - Define and maintain the target data architecture (ingestion, replication, medallion layers: Bronze/Silver/Gold) and document solutions. - Select technologies, set standards, and ensure consistent adoption across teams. - Lead or support Proofs of Concept (PoCs) for ingestion and replication solutions and drive improvements. - Ensure compliance with information security requirements and Enterprise Architecture guidelines. - Act as an expert and mentor for data engineers and ingestion specialists. - Collaborate on the ingestion platform roadmap and align capabilities with the overall data strategy.