Senior Data Engineer - Web Data & Automation

O projekcie: Senior Data Engineer - Web Data & Automation We are seeking a Data Engineer to join our global team working on innovative ways to collect and deliver unique web-based data that supports critical business decisions. You’ll work on a variety of datasets, build reliable pipelines, and develop tools that enable teams to access high-quality data efficiently. Join a team where creativity, technical expertise, and innovative thinking drive meaningful impact every day! Wymagania: - 5+ years of software development experience, strong in Python and SQL. - Experience with web technologies (HTML, JavaScript, APIs) and Linux. - Familiarity with web scraping tools (Selenium, Scrapy, Postman, XPath). - Knowledge of containerization (Docker) and cloud platforms (AWS or Azure preferred). - Strong problem-solving skills and ability to work independently. Codzienne zadania: - Build and maintain automated pipelines to gather and process web-based data. - Collaborate with teams to understand data needs and ensure timely delivery. - Implement data validation and monitoring systems for accuracy and reliability. - Develop tools to enhance data collection, processing, and infrastructure. - Participate in on-call rotations to support critical data systems.