Senior Data Engineer (Python & Databricks)

In Cyclad we work with top international IT companies in order to boost their potential in delivering outstanding, cutting-edge technologies that shape the world of the future. We are seeking an experienced Senior Data Engineer with Python and Databricks. This role supports a large-scale transformation from SQL Server–based systems to a Databricks / Delta Lake platform. The focus is on enterprise-grade data engineering and software development, not analytics or reporting. The project is SQL2Databricks migration, it involves 3500-4000 SQL DBs (2TB), replicating data in different shapes/ schemas to Databricks. Project information: • Type of project: IT Services • Office location: Poland • Work model: Remote from Poland • Budget: 140 - 160 PLN net/ h - b2b • Project length: till the end of 2026, possible to extend it • Only candidates with citizenship in the European Union and residence in Poland • Start date: ASAP Project scope: • Support a large-scale transformation from SQL Server–based systems to a Databricks / Delta Lake platform • Transform complex, business-critical SQL logic (stored procedures) into clean, maintainable, and scalable Python / PySpark code • Redesign and implement this logic in Python / PySpark within Databricks • Contribute to a large, long-running data engineering codebase used by multiple teams • Develop production-grade transformation code (packages, modules, reusable components) • Design and evolve data models within a Medallion Architecture (Bronze / Silver / Gold) across multiple data layers • Ensure software engineering quality, reusability, and long-term maintainability • Apply software engineering best practices (clean code, OOP, modularization, refactoring) • Work with very large data volumes and highly parallel, event-driven transformations • Actively participate in code reviews and technical design discussions • Support orchestration workflows (e.g., Azure Data Factory) Competence demands: • Very strong Python and PySpark skills; proven experience with Databricks and Delta Lake • Experience working in large, shared codebases (beyond notebooks) • Strong SQL skills, especially reading and understanding complex logic • Solid object-oriented programming experience, clean code principles • Strong data modelling background (transactional and analytical) • Experience in redesigning models during platform migrations • Familiarity with layered data architectures (Bronze / Silver / Gold) • Very good English skills Nice to have: • Azure Data Factory (orchestration) • Azure DevOps, Git, CI/CD pipelines • Power BI or analytics tooling • Infrastructure / DevOps knowledge (not mandatory) We offer: • Remote working model • Dynamic and innovation-driven engineering environment • Full-time job agreement based on b2b • Private medical care with dental care (covering 70% of costs) • Multisport card (also for an accompanying person) • Life insurance