Senior Data Engineer with Databricks

Nasze wymagania: Has 5+ years of commercial experience in implementing, developing, or maintaining data load systems (ETL/ELT). Demonstrates strong programming skills in Python, with a deep understanding of data-related challenges. Has hands-on experience with Apache Spark and Databricks. Is familiar with MSSQL databases. Has experience working with distributed systems on a cloud platform. Has worked on large-scale systems and understands performance optimization. Is comfortable with Git and CI/CD practices, and can design or implement deployment processes for data pipelines. Is proactive, solution-oriented, and has a strong can-do attitude. Communicates fluently in English and Polish, both written and spoken. Is a team player with excellent collaboration and communication skills. Mile widziane: Experience with Azure Experience working with SSIS Familiarity with Azure PostgreSQL Knowledge of Docker and Kubernetes Exposure to Kafka or other message brokers and event-driven architecture Experience working in Agile/Scrum environments O projekcie: What products do we develop? KMD Elements is a cloud-based solution tailored for the energy and utility market. It offers a highly efficient way to handle complex data validation and advanced formula-based settlements on time series. Designed for the international market, KMD Elements automates intricate calculation and billing processes. Key features include an advanced configuration engine, robust automation capabilities, multiple integration options, and a customer-centric interface. More info can be found here How do we work? #Agile #Scrum #Teamwork #CleanCode #CodeReview #E2Eresponsibility #ConstantImprovement Zakres obowiązków: Develop and maintain data delivery pipelines for a leading IT solution in the energy market, leveraging Apache Spark, Databricks, Delta Lake, and Python. Have end-to-end responsibility for the full lifecycle of features you develop. Design technical solutions for business requirements from the product roadmap. Ensure optimal performance. Refactor existing code and enhance system architecture to improve maintainability and scalability. Design and evolve the test automation strategy, including technology stack and solution architecture. Prepare reviews, participate in retrospectives, estimate user stories, and refine features ensuring their readiness for development. Oferujemy: Professional Development Grow in your role Enjoy on-site meetups Participate in conferences in Poland and abroad Attend an average of 40 hours of training yearly Take part in Internal Mobility Program Scandinavian Culture and Workplace Earn Competitive hourly rates/salary Enjoy MyBenefit Cafeteria system with wide range of services Make the most of your work and life Sport & passion communities and CSR initiatives Work in a human-oriented company Use high-level equipment Feel good at green and ergonomic office and enjoy surprise treats Meaningful and impactful work Make an impact that lasts - create and implement technological solutions And improve the lives of millions of people in the public and private sectors Talented and Trusted People Cooperate with open-minded colleagues Work with experienced managers in an atmosphere full of trust