Data Engineer with Streaming

We are looking for a Data Engineer with strong hands-on experience in batch data processing and practical exposure to streaming solutions. The ideal candidate understands event-driven architecture and can design scalable, real-time data pipelines on Azure. The role includes designing reliable near real-time data platforms supporting analytical and operational use cases. Tasks: • Design and implement scalable batch data pipelines on Azure using modern ETL/ELT approaches. • Develop and optimize data transformations using Apache Spark and SQL, ensuring performance and maintainability. • Design efficient data models for analytical and reporting use cases (data lakes, data warehouses). • Ensure data reliability, quality, monitoring, and performance in distributed environments. • Build and maintain near real-time data pipelines using Apache Spark (Structured Streaming). • Implement Change Data Capture (CDC) pipelines from relational databases when required. • Contribute to event-driven solutions using message brokers where streaming use cases are present. • Engage with stakeholders to refine data requirements and architecture choices. • Perform code reviews, promote best practices, and mentor junior engineers. • Work independently while maintaining effective communication with stakeholders. Requirements: • 4–6 years of experience as Data Engineer. • Strong SQL and Python skills (production-grade code). • Experience with Apache Spark (including Structured Streaming). • Hands-on experience with Azure (Synapse / ADF / ADLS / Databricks). • Understanding of distributed systems fundamentals. • Experience designing ETL/ELT pipelines. • Experience working in Agile environment. • English C1. Nice to have skills: • Experience with Apache Kafka (event streaming) and/or Apache Flink (stream processing engine). • Experience with Change Data Capture (CDC) tools (e.g. Debezium, SQL Server CDC, Azure CDC, Kafka Connect). • Experience with schema management (e.g. Avro, Schema Registry). • Experience with Delta Lake / Delta Live Tables. • Knowledge of event-driven architecture patterns. • Experience with CI/CD for data platforms. We offer:   • Stable employment in a well-established organization • Flexible work model – remote or office-based, depending on your preference • Autonomy and trust in how you organize your work • Opportunities to engage in charity and environmental projects • Access to social benefits, including vacation co-financing • Collaboration with experienced professionals and subject matter experts • Initiatives supporting well-being and health • Structured onboarding program with dedicated support • Modern equipment provided or available for remote work • Clear career development paths and internal promotion opportunities • Referral program with bonuses for recommending new team members • Access to online learning platforms and training opportunities from day one • Support for professional certifications and continuous upskilling • Inclusive and values-driven work environment