Data Engineer
Cognizant Technology Solutions
⚲ Warszawa
160 - 200 PLN netto (B2B)
Wymagania
- Java
- Python
- Kotlin
- Data
Opis stanowiska
We are looking for a talented and motivated Data Engineer to join our growing data team. In this role, you will design, build, and maintain scalable, high-performance data platforms and pipelines that support critical business operations and analytics initiatives. You will work closely with data scientists, analysts, architects, and cross-functional stakeholders to deliver reliable, secure, and efficient data solutions in a modern, cloud-native environment.
Your responsibilities
• Design, develop, and maintain scalable batch and real-time data pipelines using modern data engineering technologies.
• Build and optimize data processing solutions leveraging Apache Spark, Kafka, and distributed computing frameworks.
• Develop and manage data warehousing solutions using Apache Hive and SQL-based technologies.
• Implement and maintain workflow orchestration using Apache Airflow, ensuring reliability and operational excellence.
• Establish and enforce data quality, governance, security, and compliance standards across data platforms.
• Monitor, troubleshoot, and optimize data infrastructure, pipelines, and processing jobs to improve performance and scalability.
• Design and execute automated testing strategies, including unit and integration testing for data workflows.
• Develop, deploy, and manage containerized applications and data services using Docker and Kubernetes.
• Build and maintain CI/CD pipelines to enable automated testing, deployment, and monitoring of data solutions.
• Collaborate with data scientists, analysts, product teams, and business stakeholders to understand requirements and deliver impactful data products.
• Document technical solutions, best practices, and operational procedures to support maintainability and knowledge sharing.
• Drive continuous improvement initiatives focused on reliability, scalability, and operational efficiency.
Our requirements
• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field, or equivalent practical experience.
• Proven experience as a Data Engineer or in a similar data-focused engineering role.
• Strong programming skills in Python, Java, and/or Kotlin.
• Hands-on experience with Apache Spark, Hadoop, Kafka, Hive, Airflow, and SQL Server.
• Strong understanding of distributed systems, data architecture, and scalable data processing frameworks.
• Experience with software testing methodologies and automation frameworks such as PyTest or JUnit.
• Knowledge of containerization and orchestration technologies, including Docker and Kubernetes.
• Familiarity with modern CI/CD practices and tools.
• Strong analytical, problem-solving, and troubleshooting capabilities.
• Excellent communication skills and ability to work effectively in a collaborative, cross-functional environment.
Optional
• Experience working with cloud platforms (AWS, Azure, or GCP).
• Exposure to data lake, lakehouse, or modern data platform architectures.
• Experience with Infrastructure as Code (Terraform, CloudFormation, or similar tools).
• Knowledge of data security, governance, and regulatory compliance frameworks.
• Experience supporting machine learning or advanced analytics workloads.
Your responsibilities
• Design, develop, and maintain scalable batch and real-time data pipelines using modern data engineering technologies.
• Build and optimize data processing solutions leveraging Apache Spark, Kafka, and distributed computing frameworks.
• Develop and manage data warehousing solutions using Apache Hive and SQL-based technologies.
• Implement and maintain workflow orchestration using Apache Airflow, ensuring reliability and operational excellence.
• Establish and enforce data quality, governance, security, and compliance standards across data platforms.
• Monitor, troubleshoot, and optimize data infrastructure, pipelines, and processing jobs to improve performance and scalability.
• Design and execute automated testing strategies, including unit and integration testing for data workflows.
• Develop, deploy, and manage containerized applications and data services using Docker and Kubernetes.
• Build and maintain CI/CD pipelines to enable automated testing, deployment, and monitoring of data solutions.
• Collaborate with data scientists, analysts, product teams, and business stakeholders to understand requirements and deliver impactful data products.
• Document technical solutions, best practices, and operational procedures to support maintainability and knowledge sharing.
• Drive continuous improvement initiatives focused on reliability, scalability, and operational efficiency.
Our requirements
• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field, or equivalent practical experience.
• Proven experience as a Data Engineer or in a similar data-focused engineering role.
• Strong programming skills in Python, Java, and/or Kotlin.
• Hands-on experience with Apache Spark, Hadoop, Kafka, Hive, Airflow, and SQL Server.
• Strong understanding of distributed systems, data architecture, and scalable data processing frameworks.
• Experience with software testing methodologies and automation frameworks such as PyTest or JUnit.
• Knowledge of containerization and orchestration technologies, including Docker and Kubernetes.
• Familiarity with modern CI/CD practices and tools.
• Strong analytical, problem-solving, and troubleshooting capabilities.
• Excellent communication skills and ability to work effectively in a collaborative, cross-functional environment.
Optional
• Experience working with cloud platforms (AWS, Azure, or GCP).
• Exposure to data lake, lakehouse, or modern data platform architectures.
• Experience with Infrastructure as Code (Terraform, CloudFormation, or similar tools).
• Knowledge of data security, governance, and regulatory compliance frameworks.
• Experience supporting machine learning or advanced analytics workloads.
🔍 Dekoder Ogłoszenia
🔴
join our growing data team
Zespół może być w fazie tworzenia, co oznacza potencjalnie brak ugruntowanych procesów i potrzebę aktywnego kształtowania sposobu pracy.
🔴
support critical business operations and analytics initiatives
Twoja praca będzie miała bezpośredni wpływ na kluczowe procesy firmy, co może oznaczać wysokie oczekiwania i presję.
🟡
work closely with data scientists, analysts, architects, and cross-functional stakeholders
Oczekuje się od Ciebie umiejętności efektywnej komunikacji i współpracy z różnymi zespołami, co może wymagać zarządzania wieloma priorytetami i perspektywami.
🔴
modern, cloud-native environment
Chociaż brzmi to nowocześnie, może oznaczać konieczność szybkiego uczenia się i adaptacji do specyficznych, często szybko zmieniających się technologii chmurowych.
🟡
operational excellence
Wymaga to nie tylko tworzenia rozwiązań, ale także dbania o ich stabilność, niezawodność i ciągłe doskonalenie w środowisku produkcyjnym.