Tech Lead (Databricks | Azure | PySpark)
Link Group
⚲ Warszawa
160 - 190 PLN/h netto (B2B)
Wymagania
- CI/CD
- PySpark
- medallion architecture
- Azure
- Technical leadership
- Databricks
Opis stanowiska
Tech Lead (Databricks | Azure | PySpark) - Praca Hybrydowa- Warszawa We’re building a team to bring structure and clarity to how data work is planned and delivered - and we’re looking for someone who enjoys process thinking and cross-team collaboration. We are looking for: A Tech Lead with strong hands-on Data Engineering experience in Databricks on Azure, who can design and optimize data pipelines and lead delivery in a distributed team setup. Apply if you have: • 5+ years of experience as a Data Engineer (or similar) • 2+ years in a Tech Lead role (technical leadership, guiding solutions, supporting the team) • Strong PySpark skills (distributed processing - not only Pandas) • Hands-on experience with Databricks, including:• Environment & compute configuration Lakeflow Declarative Pipelines • Asset Bundles and CI/CD • Understanding and practical use of Medallion Architecture • Experience with Azure, e.g. Key Vault, Azure SQL, ADF (and similar services) • English - must have (US-based client) Nice to have: • Experience in insurance or finance • Consulting background • Data modeling experience You'll be joining... A project for a large US insurance client. The work focuses on introducing and optimizing data flows between the client’s insurance core system and Databricks - improving reliability, performance, and overall data platform structure.