NoFluffJobs Praca zdalna Senior New

Senior Data Engineer

ARDURA Consulting

⚲ Remote

24 360 - 26 040 PLN (B2B)

Wymagania

  • Python
  • Snowflake
  • Spark
  • AWS
  • Azure

Opis stanowiska

O projekcie: - Fully remote work - International work environment - B2B cooperation - Private medical care Wymagania: - Extensive hands-on experience in cloud data warehousing with Snowflake and transformation modeling using dbt. - Proficiency in writing complex SQL queries with a strong focus on execution performance and optimization. - Proven track record of managing production-grade pipelines with Apache Airflow (or equivalent scheduling frameworks). - Solid background in Software Engineering, specifically in building robust APIs and backend services. - Mastery of Python with a deep commitment to Object-Oriented Programming (OOP) principles. - Experience with Apache Spark (preferably Databricks) - High standard for code quality, focusing on clean, scalable architectures and comprehensive unit testing suites. - Practical knowledge of containerization (Docker, Kubernetes) and implementing modern CI/CD automation. - Familiarity with major cloud ecosystems (AWS or Azure) and professional version control workflows using Git. - Fluency in English (minimum C1 level), enabling seamless collaboration in a professional environment. Codzienne zadania: - Architect and manage high-performance ETL workflows and data pipelines utilizing Python, SQL, dbt, Snowflake, and Airflow. - Design sophisticated data models and refine transformation logic to maximize system efficiency and workflow performance. - Maintain rigorous standards for data integrity, consistency, and overall quality across the platform. - Consolidate diverse information streams into comprehensive, centralized datasets. - Collaborate on server-side engineering, including the development of robust APIs, data access layers, and backend-to-frontend interface specifications. - Drive the integration of platform-wide services and scalable cloud-based infrastructures. - Deliver high-quality, maintainable, and well-tested code while contributing to a collaborative code-review culture. - Create detailed records of data architectural patterns and system-wide processing logic.