JustJoin.IT Praca zdalna Senior

Senior Data Engineer (MLOps)

Harvey Nash Technology

⚲ Warszawa, Kraków, Poznań, Gdańsk, Wrocław

160 - 180 PLN/h netto (B2B)

Wymagania

  • PySpark
  • Data
  • Azure
  • Databricks

Opis stanowiska

Senior Data Engineer / MLOps  Remote, PolandB2B till August  160–180 PLN/h Responsibilities • Design & maintain end-to-end data & ML pipelines (Databricks Workflows, Delta Lake, Unity Catalog) • Build reproducible training & deployment workflows (experiment tracking, model registry, artifact management) • Implement data quality frameworks, observability metrics, dashboards (Lakeview, Grafana) • Automate ingestion & feature pipelines via PySpark, SQL Warehouses, DAB within CI/CD • Manage security, access control & compliance in data/ML environments • Optimize compute performance & cost (autoscaling, spot instances, caching, partitioning) • Develop automated evaluation & validation pipelines (new telemetry, reproducibility, traceability) • Maintain continuous model & data monitoring (drift, feature stability, prediction quality) • Ensure environment consistency via IaC & containerization (Terraform) Requirements • Senior Data Engineer + solid MLOps background • Azure Databricks (Workflows, Delta Lake, Unity Catalog) • PySpark, SQL Warehouses, production-grade pipeline development • CI/CD (GitHub Actions / Azure DevOps) • Monitoring tools (Lakeview, Grafana), ML observability • Data quality, drift detection, ML monitoring • Security, access management & compliance in data/ML ecosystems • Terraform / IaC