Microsoft Fabric Data Engineer / Data Platform Engineer
emagine Polska
⚲ Lisbon
Wymagania
- Documentation
- Business Intelligence (BI)
- Performance optimization
- Artificial Intelligence (AI)
- DataStage (ETL)
- SQL
- Python
- Security
- ETL
- CI/CD
Opis stanowiska
Position Overview: We are seeking a skilled and hands-on Microsoft Fabric Data Engineer / Data Platform Engineer to drive the development of our innovative data platform. This role demands significant expertise in data ingestion and ETL/ELT processes, particularly utilizing Microsoft Fabric's capabilities. Ideal candidates will thrive in a collaborative setting, demonstrating strong technical skills alongside professional communication abilities. Main Responsibilities: • Design, build, and maintain data ingestion pipelines in Microsoft Fabric. • Develop ETL/ELT processes using Fabric pipelines, notebooks, Python, and SQL. • Ingest data from various source systems, including databases, APIs, and business applications. • Work with lakehouses and structured data layers such as raw and curated data. • Implement incremental loads, dependency handling, data validation, and error handling. • Optimize pipelines and notebooks for performance and maintainability. Key Requirements: • Strong experience as a Data Engineer or Data Platform Engineer. • Solid hands-on experience with data ingestion and ETL/ELT development. • Experience with Microsoft Fabric, pipelines, notebooks, and lakehouses. • Proficient in Python and SQL, particularly in data engineering contexts. • Experience with modern data platforms and cloud-based architectures. • Good understanding of orchestration and pipeline design principles. • Ability to write clean and maintainable code. • Excellent English communication skills. Nice to Have: • Familiarity with GitHub Copilot and similar AI-assisted tools. • Experience with Azure Data Factory, and other Azure data services. • Knowledge of data governance and quality frameworks. • Experience in industries such as retail, finance, or real estate. Other Details: This is a full-time position based in Portugal, commencing on August 1, 2026, with an initial duration of 6 months and potential for extension, aiming for the consultant to become a key team member.