Senior Data Engineer (Azure, Databricks , Python) k/m/*

O projekcie: Join a global technology team delivering innovative, AI-driven solutions supporting tax services for one of the world’s leading professional services organizations. You will work on large-scale data platforms and modern cloud-based architectures, collaborating with cross-functional teams across engineering, tax, and business domains. Wymagania: - 5+ years of hands-on experience in software development - Extensive experience working with Apache Spark, including platforms such as Databricks and/or Azure Synapse/Fabric - Proficient in Python, with strong skills in data manipulation using Pandas/Polars and similar - Solid understanding of columnar data storage formats, particularly Parquet, with practical experience using Delta Tables - Proven expertise in data processing, analysis, and transformation workflows - Strong analytical and problem-solving abilities with a detail-oriented mindset - Practical and pragmatic approach to balancing standardized processes with flexibility to meet project goals effectively - Excellent organizational skills with the ability to self-manage, prioritize tasks, structure workload, and meet tight deadlines - Solid understanding of microservices architecture and its implementation in scalable systems Codzienne zadania: - Define and enforce best practices and coding standards across the project - Conduct thorough code reviews to ensure adherence to established guidelines and maintain high code quality - Working both independently and in close collaboration with others in the team - Communicating clear instructions to team members and helping manage the flow of day-to-day operations - Communicating with the client regularly - Design, develop, and maintain robust and scalable Spark applications - Write clean, maintainable, and efficient code following best practices and coding standards - Optimize code for performance and scalability, ensuring efficient data handling - Work closely with cross-functional teams to deliver high-quality software solutions - Identify and resolve technical issues, ensuring the reliability and performance of applications - Create and maintain comprehensive documentation for code, processes, and workflows