Senior Data Engineer (Databricks)
Square One Resources
⚲ Warsaw
21 840 - 26 880 PLN (B2B)
Wymagania
- Azure
- CI/CD
- Databricks
- SQL Server
- PostgreSQL
- Kubernetes
- Terraform
- Infrastructure as Code
- CD pipelines
- ETL
- R (nice to have)
- Python (nice to have)
- Grafana (nice to have)
Opis stanowiska
O projekcie: We are looking for a Senior Data Engineer with Databricks experience to join our client's project. In this role, you'll design, implement, and maintain data solutions within the product platform. Wymagania: Our requirements - Experience with SQL Server and PostgreSQL/TimescaleDB, including time-series schema design. - Familiarity with Kubernetes and deployment of data-related services. - Terraform for infrastructure as code. - Azure DevOps: CI/CD pipelines, repositories, and release management. - Experience with on-prem ETL tools (Node-RED, Apache NiFi). - Knowledge of modern cloud ETL frameworks, especially Databricks. - Ability to design efficient data models at an architectural level. - Capability to perform data analysis, extract insights and collaborate on business-oriented analytical structures. - Technical knowledge of Azure IoT Hub: ingestion, device management, telemetry, scalability. Optional - Experience with analytics and visualization tools (R, Python, Grafana…). - Background in industrial digital platforms or smart factory environments. - Experience working with software product teams in agile environments (Scrum). Codzienne zadania: - Design, implement, and maintain data solutions within the product platform. - Define and optimize data models for analytical, operational, and predictive use cases. - Participate in data architecture and technical infrastructure decisions. - Ensure quality, robustness, and maintainability through good CI/CD and automation practices. - Collaborate with product owners, developers, and stakeholders to translate business needs into technical solutions.