JustJoin.IT Praca zdalna Mid New

Data Engineer

Holisticon Insight

⚲ Wrocław

140 - 180 PLN/h netto (B2B)

Wymagania

  • PySpark
  • Pandas
  • REST API connectors
  • SQL
  • Python

Opis stanowiska

Holisticon Insight is a data-focused technology and consulting company, part of the Nexer Group. Our mission is simple: We make companies Data Driven. We help organizations turn data into real business value. We design and build modern data platforms, business intelligence solutions, and AI systems that help companies make better decisions, improve operations, and create new digital services. Our expertise covers the whole data journey - from collecting and integrating data, through analytics and visualization, to advanced AI and machine learning. We achieve this by combining our expertise in building data platforms and IoT platforms, using business intelligence, and applying artificial intelligence and machine learning to enable more advanced analytics. At Holisticon Insight we focus on strong competencies, collaboration, and delivering real outcomes for our customers. We keep a family-like culture with flat structure and empowered teams where every voice counts.   Check us out! 👇https://holisticon.pl/holisticon-insight/ 🚀 We are looking for a Data Engineers who will serve as the foundational builder of this project. You will build and maintain the data infrastructure to ingest, standardize and move data into the ML training environment. The core challenge is dealing with highly sparse, fragmented biological data across disconnected systems (like Genesys, GRIN-Global, and GIGWA).   As a Data Engineer, you will:• Develop API and SQL-based connectors for diverse data sources and build automated ingestion scripts to centralize tables. • Standardize raw data into a unified staging format, implement version control for raw datasets, and establish data lineage tracking from source to staging. • Map data schemas across different tables to identify overlaps, quantify sparsity levels, and identify missingness patterns. • Implement secure credential management for database access. You might be the perfect match if you possess the following competencies: • Core Tech: Advanced SQL, Python (Pandas, PySpark), and deep experience building REST API connectors. • Data Architecture: Proven track record of designing data staging environments and managing complex data topologies. • Domain Context: Previous experience handling fragmented, sparse datasets; familiarity with biological or agricultural data schemas is a strong plus. By joining Holisticon Insight you will get: • Life insurance • Multisport card • Fully remote job • Private medical care • Flexible working hours • B2B contract • Amazing integration events on a regular basis • Training budget (e.g. Microsoft Azure Certifications) • Opportunity to impact our company culture build-up • Work equipment (laptop, 2 monitors, and accessories)