JustJoin.IT Hybrydowo Senior New

Senior Test Engineer – Data & AI

emagine Polska

⚲ Warsaw

Wymagania

  • Data security
  • Documentation
  • Artificial Intelligence (AI)
  • DataStage (ETL)
  • SQL
  • Python
  • Testing
  • Security
  • ETL
  • CI/CD

Opis stanowiska

contract: B2B rate: 145 pln/h + VAT mode: 2x a month from the office, Warsaw As a Senior Test Engineer, you will be responsible for ensuring the quality, reliability, and performance of Data Hubs and data processing pipelines in Azure & Databricks. You will develop automated test frameworks, conduct regression testing, and validate large-scale data processing workflows. How you will get the job done ·       designing, developing, and maintaining automated test frameworks for data processing and orchestration. ·       conducting regression, performance, and scalability testing for data ingestion and transformation. ·       implementing data quality validation and anomaly detection in Azure-based data pipelines. ·       collaborating with Data Engineers and DevOps teams to integrate testing into CI/CD pipelines. ·       ensuring compliance with data security, governance, and privacy standards. ·       defining test strategies, best practices, and documentation for Data & AI solutions Skills and experience you will need ·       strong expertise in Python, PySpark, SQL, and test automation frameworks. ·       experience with Azure Data Services (Databricks, Data Factory, Storage Accounts). ·       proficiency in testing big data pipelines, distributed systems, and ETL workflows. ·       hands-on experience with CI/CD tools (Azure DevOps, Jenkins) and test automation. ·       strong understanding of data governance, quality frameworks, and monitoring tools. ·       excellent problem-solving skills and ability to work in Agile/Scrum environments. Nice to Have ·       experience with ML model validation and AI pipeline testing ·       familiarity with data lineage tracking and metadata management tools