Senior Data Engineer

O projekcie: 🔹 For our Client from pharmaceutical industry we are looking for Senior Data Engineer🔹 Senior Data Engineer will join the DataCore team. DataCore enables the development and consumption of new and existing data products in a scalable and secure manner – supported by an overarching Data Governance Framework. The responsibility for the data engineer will be to manage the orchestration of application-specific data products and aggregated shared insights. Wymagania: - Extensive experience with Azure, Azure Databricks, and a deep understanding of Azure architecture and services - Strong proficiency in Python programming - Experience in using Spark, including Spark SQL and understanding of how to optimize Spark performance - Automated unit testing and code quality inspection - Experience with CI/CD (GitHub actions / Azure DevOps) - Familiarity with AWS - Educational background in Computer Science, Software Development or Engineering - Working in pharma domain or other regulated area is considered an advantage Codzienne zadania: - Collaborate with cross-functional teams to design, develop and maintain data pipelines and analytics solutions. - Design and build a foundational platform for a modern data lake architecture, optimizing it for scalability, flexibility, and performance. - Develop automated test to ensure data accuracy and quality. - Continuously secure improvement that can make developers on the platform work even more efficiently and act as a sparring partner on use of Azure services for the organisation. - Leverage your expertise in cloud development to design and implement innovative digital solutions focused on delivering business insights and patient care in real time.