Senior Databricks Engineer

We’re looking for specialists open to cooperate on B2B basis, for our customer – Avanade Poland.
Avanade website; Privacy policy

This role is available for both specialists open to work remotely (within Poland) or in hybrid mode (offices in Wroclaw and Krakow).

Position:
As Senior Databricks Engineer, you will be working in projects for various domains and industries, focused mostly around Databricks and Azure cloud. Among your tasks there will be:
• Designing, building, and maintaining scalable, efficient, and reliable data pipelines
• End-to-end development of data architectures and ETL processes
• Collaborating with data scientists, analysts, and other engineering teams to ensure data integration and optimization
• Implementing best engineering practices across data systems
• Optimizing performance of data workflows and ensuring the reliability of data solutions
• Staying up-to-date with the latest developments in data engineering world
• Acting as a Team Lead in the project if needed
• Possibility to develop yourself in AI engineering

Required skills:
For this role, we require commercial experience with:
• Databricks
• Azure cloud and services (e.g. Azure Data Factory, Data Lake, SQL Database, Azure Databricks)
• Python and PySpark
• SQL
• Data Engineering concepts such as ETL, data modeling, data warehousing, data governance
• Docker and Kubernetes
• English (B2)
Nice to have:
• Knowledge of OCR and corresponding libraries (e.g. easyOCR)
• Any experience in data science area

If you want to ask any questions before applying, feel free to reach out via LinkedIn!