Data Engineer (AWS, Databricks)
⚲ Warsaw
Do uzgodnienia
Wymagania
- Documentation
- maintenance
- Artificial Intelligence (AI)
- DataStage (ETL)
- SQL
- Python
- Cloud
- Security
- ETL
- CI/CD
Opis stanowiska
Industry: PharmaceuticalStart: ASAP
Work model: Remote
Contract: B2B
Length of contract: 03/08/2026 - 02/02/2027+ extensions
Summary: We are looking for a hands-on Senior Data Engineer to build, maintain, and migrate data pipelines on AWS Cloud to support our evolving data platforms. The role focuses on integrating new data sources while ensuring the architecture is functional and efficient.
Responsibilities:
• Lead the design, development, and maintenance of data pipelines (ingestion, transformation orchestration, monitoring)
• Re-write ETL flows using Databricks
• Integrate and configure Databricks for data processing and pipeline execution
• Support data migration from decommissioned sources to new data lakes
• Build and optimize AWS cloud infrastructure related to data ingestion and processing
• Ensure data quality, reliability, and observability (logging, monitoring, error handling)
• Experience with CI/CD and infrastructure-as-code tools
• Implement secure data movement and access patterns
• Collaborate with engineering and stakeholders to validate data flows
• Contribute to documentation and knowledge transfer
• Work independently
Must Haves:
• Experience with AWS Cloud for data platforms
• Strong scripting/programming skills in Python and SQL
• Hands-on experience with Databricks
• Experience in designing and maintaining data pipelines
• Knowledge of CI/CD processes and infrastructure as code (CDK)
Nice to Haves:
• Experience in regulated environments (e.g., healthcare/pharma)
• Knowledge in data science and insights generation
• Experience with AI and agentic coding
Work model: Remote
Contract: B2B
Length of contract: 03/08/2026 - 02/02/2027+ extensions
Summary: We are looking for a hands-on Senior Data Engineer to build, maintain, and migrate data pipelines on AWS Cloud to support our evolving data platforms. The role focuses on integrating new data sources while ensuring the architecture is functional and efficient.
Responsibilities:
• Lead the design, development, and maintenance of data pipelines (ingestion, transformation orchestration, monitoring)
• Re-write ETL flows using Databricks
• Integrate and configure Databricks for data processing and pipeline execution
• Support data migration from decommissioned sources to new data lakes
• Build and optimize AWS cloud infrastructure related to data ingestion and processing
• Ensure data quality, reliability, and observability (logging, monitoring, error handling)
• Experience with CI/CD and infrastructure-as-code tools
• Implement secure data movement and access patterns
• Collaborate with engineering and stakeholders to validate data flows
• Contribute to documentation and knowledge transfer
• Work independently
Must Haves:
• Experience with AWS Cloud for data platforms
• Strong scripting/programming skills in Python and SQL
• Hands-on experience with Databricks
• Experience in designing and maintaining data pipelines
• Knowledge of CI/CD processes and infrastructure as code (CDK)
Nice to Haves:
• Experience in regulated environments (e.g., healthcare/pharma)
• Knowledge in data science and insights generation
• Experience with AI and agentic coding
🔍 Dekoder Ogłoszenia
🔴
hands-on Senior Data Engineer
Oczekuje się, że będziesz aktywnie kodować i rozwiązywać problemy techniczne, a nie tylko zarządzać zespołem lub delegować zadania.
🔴
support our evolving data platforms
Może oznaczać, że obecne platformy są niestabilne lub w trakcie ciągłych zmian, co może prowadzić do nieprzewidzianych problemów.
🔴
Lead the design, development, and maintenance of data pipelines
Chociaż brzmi to jak rola lidera, może oznaczać, że będziesz odpowiedzialny za te zadania jako jedyny inżynier, bez wsparcia zespołu.
🔴
Work independently
Oznacza to, że będziesz musiał radzić sobie z problemami samodzielnie, bez częstego wsparcia ze strony innych członków zespołu.
🔴
Length of contract: 03/08/2026 - 02/02/2027+ extensions
Podany okres kontraktu jest stosunkowo krótki, a 'extensions' sugeruje niepewność co do jego faktycznego przedłużenia.