Data Engineer

Mode: Remote Contract: B2B Summary: The Senior Data Engineer role is crucial for enhancing data products, focused on improving data management processes to support patient care and organizational goals. Responsibilities: • Collaborate with cross-functional teams to design, develop, and maintain data pipelines and analytics solutions. • Design and build a foundational platform for a modern data lake architecture, optimizing it for scalability, flexibility, and performance. • Develop automated tests to ensure data accuracy and quality. • Continuously secure improvement to enhance developer efficiency and act as a sparring partner on the use of Azure services for the organization. • Leverage cloud development expertise to design and implement digital solutions focused on business insights and patient care. Key Requirements: • Extensive experience with Azure, Azure Databricks, and a deep understanding of Azure architecture and services. • Strong proficiency in Python programming. • Experience using Spark, including Spark SQL, with an understanding of how to optimize Spark performance. • Automated unit testing and code quality inspection experience. • Experience with CI/CD (GitHub actions / Azure DevOps). • Familiarity with AWS. • Experience in the pharma domain or other regulated areas. Nice to Have: • Proven ability to work in a collaborative team environment. • Willingness to receive and act on feedback for personal and professional growth. • Fluency in English, both written and spoken. Other Details: • Team Structure - Collaborative team focused on innovation in patient care.