Data Engineer
Link Group
⚲ Remote
20 160 - 25 200 PLN (B2B)
Wymagania
- Data engineering
- Azure Databricks
- Azure Functions
- Azure Event Hub
- ETL
- Python
- AI
Opis stanowiska
O projekcie: What’s in it for you - Work on a modern Azure data stack with advanced analytics and AI-related use cases. - Own high-impact challenges in streaming, large-scale processing, and production integration. - Contribute to strategic initiatives with strong growth and innovation opportunities. Wymagania: - 3+ years of experience in Data Engineering or Software Engineering focused on data-intensive systems. - Hands-on experience with Azure Databricks, Azure Functions, and Azure Event Hubs. - Strong ETL/ELT pipeline development experience. - Strong Python programming skills. - Experience integrating APIs, analytics services, or LLM-based capabilities into pipelines. - Strong knowledge of distributed data processing, monitoring, resilience, and data quality. - Knowledge of Generative AI, RAG, and ML integration patterns. Nice to have - Experience integrating ML models or advanced analytics into production pipelines. - Familiarity with observability data formats such as metrics, traces, and logs. Codzienne zadania: - Build and optimize data pipelines supporting Custom Triage functionality. - Implement scalable ETL/ELT workflows for ingesting, transforming, and exposing processed data. - Integrate event-driven data sources with Azure-based processing environments. - Enable data consumption by platform services, analytics workloads, and AI-driven components. - Collaborate with architects and engineering teams to deliver reliable, scalable, and maintainable data solutions. - Improve observability, performance, resilience, and cost efficiency across the platform.