JustJoin.IT Praca zdalna Senior New

Databricks Data Engineer

emagine Polska

⚲ Warsaw

Do uzgodnienia

Wymagania

  • Documentation
  • SQL
  • Operations
  • Performance optimization
  • CI/CD
  • Governance
  • PySpark
  • Microsoft Azure Databricks
  • Data Management
  • Data Engineering

Opis stanowiska

•

Contract B2B, 32 weeks
• Rate: hourly
• Full-time, typical core hours
• Working model: remote
• Language: English
• Start: 1.12.2026

This role involves building and maintaining data pipelines and core data products using Databricks, ensuring they are sustainable and manageable by the engineering team.

Responsibilities:
• Build bronze, silver, and gold pipelines in PySpark and SQL to the agreed patterns.
• Implement core data products with data contracts, tests, and documentation.
• Make pipelines idempotent and re-runnable; handle replay, backfill, and late-arriving data.
• Deploy through CI/CD with Databricks Asset Bundles, including unit tests and data-quality checks.
• Tune performance and costs through Delta optimization, liquid clustering, and compute sizing.
• Reconcile migrated data against Oracle sources.
• Collaborate with data engineers and document everything through runbooks.

Must Haves:
• Experience with Databricks and building data pipelines.
• Proficiency in PySpark and SQL.
• Strong understanding of CI/CD processes.
• Ability to implement data quality checks and tests.

Nice to Haves:
• Experience with Delta Lake and data optimization.
• Familiarity with Oracle databases.
• Knowledge of data governance and documentation practices.

🔍 Dekoder Ogłoszenia

✓ Ogłoszenie wygląda transparentnie — brak typowych czerwonych flag.