Senior Data Engineer
Cognizant Technology Solutions
⚲ Warszawa
30 240 - 33 600 PLN netto (B2B)
Wymagania
- Python
- SQL
- Databricks
- Azure
- CI/CD
- ADF
Opis stanowiska
Location: Poland - 100% remoteAbout the Role
We are looking for a Senior Data Engineer who is passionate about building scalable, high-impact data solutions. In this role, you will design and deliver modern Data Hubs that support analytics, operational processes, reporting, and Generative AI use cases. You will also play a key role in shaping architecture, defining best practices, and mentoring engineers to ensure high-quality delivery across the data landscape.
Key Responsibilities
• Design and implement scalable Data Hubs that integrate multiple data sources
• Define architecture standards, best practices, and engineering patterns
• Provide technical leadership, mentor engineers, and conduct code reviews
• Develop and maintain batch and real-time data pipelines
• Ensure data quality through validation frameworks, monitoring, and anomaly detection
• Implement automation and CI/CD pipelines to streamline delivery
• Ensure data security, governance, and compliance with relevant standards
• Create and maintain clear, structured technical documentation
Required Skills and Experience
• Strong expertise in Python and SQL
• Hands-on experience with Databricks (primary tool) and Apache Spark
• Solid knowledge of the Azure data ecosystem, including Data Factory, ADLS, Synapse, Azure SQL, and Event Hubs
• Experience with real-time data processing and streaming architectures
• Proficiency in DevOps practices, including CI/CD, Terraform, Docker, and Kubernetes/AKS
• Experience in mentoring engineers and driving technical standards
• Strong communication and documentation skills
• English proficiency at B2 level or higher
Technology Stack
• Core tools: Databricks, Apache Spark, Delta Lake
• Azure services: Data Factory, ADLS, Synapse, Azure SQL, Azure DevOps, Event Hubs
• Development and automation: Python, SQL, GitHub, Terraform, Docker, Kubernetes/AKS
This role offers the opportunity to influence data strategy, shape architecture, and mentor a growing team while delivering impactful and future-ready data solutions.
We are looking for a Senior Data Engineer who is passionate about building scalable, high-impact data solutions. In this role, you will design and deliver modern Data Hubs that support analytics, operational processes, reporting, and Generative AI use cases. You will also play a key role in shaping architecture, defining best practices, and mentoring engineers to ensure high-quality delivery across the data landscape.
Key Responsibilities
• Design and implement scalable Data Hubs that integrate multiple data sources
• Define architecture standards, best practices, and engineering patterns
• Provide technical leadership, mentor engineers, and conduct code reviews
• Develop and maintain batch and real-time data pipelines
• Ensure data quality through validation frameworks, monitoring, and anomaly detection
• Implement automation and CI/CD pipelines to streamline delivery
• Ensure data security, governance, and compliance with relevant standards
• Create and maintain clear, structured technical documentation
Required Skills and Experience
• Strong expertise in Python and SQL
• Hands-on experience with Databricks (primary tool) and Apache Spark
• Solid knowledge of the Azure data ecosystem, including Data Factory, ADLS, Synapse, Azure SQL, and Event Hubs
• Experience with real-time data processing and streaming architectures
• Proficiency in DevOps practices, including CI/CD, Terraform, Docker, and Kubernetes/AKS
• Experience in mentoring engineers and driving technical standards
• Strong communication and documentation skills
• English proficiency at B2 level or higher
Technology Stack
• Core tools: Databricks, Apache Spark, Delta Lake
• Azure services: Data Factory, ADLS, Synapse, Azure SQL, Azure DevOps, Event Hubs
• Development and automation: Python, SQL, GitHub, Terraform, Docker, Kubernetes/AKS
This role offers the opportunity to influence data strategy, shape architecture, and mentor a growing team while delivering impactful and future-ready data solutions.
🔍 Dekoder Ogłoszenia
🔴
passionate about building scalable, high-impact data solutions
Oczekuje się, że będziesz entuzjastycznie podchodzić do pracy i generować znaczące rezultaty, co może oznaczać presję na wyniki.
🟡
play a key role in shaping architecture, defining best practices, and mentoring engineers
Poza stricte technicznymi obowiązkami, będziesz odpowiedzialny za strategiczne decyzje i rozwój zespołu, co może oznaczać dodatkowe zadania.
🟡
Ensure data quality through validation frameworks, monitoring, and anomaly detection
Będziesz odpowiedzialny za proaktywne wykrywanie i rozwiązywanie problemów z jakością danych, co może wymagać ciągłej uwagi i reagowania.
🟡
Implement automation and CI/CD pipelines to streamline delivery
Oczekuje się, że będziesz aktywnie wdrażać i utrzymywać procesy automatyzacji, co może wymagać nauki nowych narzędzi i ciągłego doskonalenia.
🔴
Experience in mento
To jest niedokończony punkt, który sugeruje, że mentoring jest ważny, ale brakuje szczegółów na temat zakresu i oczekiwań.