Senior Test Engineer – Data & AI
emagine Polska
⚲ Warsaw
Wymagania
- Data security
- Documentation
- Artificial Intelligence (AI)
- DataStage (ETL)
- SQL
- Python
- Testing
- Security
- ETL
- CI/CD
Opis stanowiska
contract: B2B rate: 145 pln/h + VAT mode: 2x a month from the office, Warsaw As a Senior Test Engineer, you will be responsible for ensuring the quality, reliability, and performance of Data Hubs and data processing pipelines in Azure & Databricks. You will develop automated test frameworks, conduct regression testing, and validate large-scale data processing workflows. How you will get the job done · designing, developing, and maintaining automated test frameworks for data processing and orchestration. · conducting regression, performance, and scalability testing for data ingestion and transformation. · implementing data quality validation and anomaly detection in Azure-based data pipelines. · collaborating with Data Engineers and DevOps teams to integrate testing into CI/CD pipelines. · ensuring compliance with data security, governance, and privacy standards. · defining test strategies, best practices, and documentation for Data & AI solutions Skills and experience you will need · strong expertise in Python, PySpark, SQL, and test automation frameworks. · experience with Azure Data Services (Databricks, Data Factory, Storage Accounts). · proficiency in testing big data pipelines, distributed systems, and ETL workflows. · hands-on experience with CI/CD tools (Azure DevOps, Jenkins) and test automation. · strong understanding of data governance, quality frameworks, and monitoring tools. · excellent problem-solving skills and ability to work in Agile/Scrum environments. Nice to Have · experience with ML model validation and AI pipeline testing · familiarity with data lineage tracking and metadata management tools