Senior Data Engineer with Python
Link Group
⚲ Warszawa
33 000 - 45 000 PLN (PERMANENT)
Wymagania
- Data engineering
- Python
- Data Lake
- Cloud
- ETL (nice to have)
- AWS (nice to have)
- GCP (nice to have)
- Azure (nice to have)
- Storage (nice to have)
- Docker (nice to have)
- Kubernetes (nice to have)
Opis stanowiska
O projekcie: Data Engineer (Python) We are looking for a Data Engineer with strong Python skills to join our team and support the development of scalable data processing solutions. This role focuses on building and optimizing data pipelines, working with large datasets, and enabling efficient data flow across systems. We offer - Opportunity to work with large-scale data systems - Exposure to modern data technologies and cloud environments - Collaborative and engineering-driven culture - Flexible working conditions Wymagania: - Solid experience in data engineering, preferably with batch processing or ETL workflows - Strong hands-on experience with Python (Python-first mindset) - Experience in ingesting and processing data (e.g., collecting, transforming, and loading data into storage systems such as data lakes) - Good understanding of working with large-scale and high-volume datasets - Knowledge of designing and optimizing data processing workflows - Familiarity with cloud environments (AWS, GCP, or Azure) - Strong analytical thinking and problem-solving skills Nice to have - Experience working with financial or market data - Familiarity with columnar storage formats (e.g., Parquet) - Knowledge of modern data lake or data platform concepts - Experience with containerization (e.g., Docker, Kubernetes) - Exposure to timeseries data or low-latency data processing Codzienne zadania: - Design, build, and maintain data pipelines for processing large-scale datasets - Develop solutions for data ingestion, transformation, and storage using Python - Work with structured and unstructured data from various external and internal sources - Optimize data workflows to ensure performance, scalability, and reliability - Collaborate with engineering and business teams to understand data needs and deliver solutions - Ensure data quality through validation, monitoring, and error handling mechanisms - Contribute to the development of modern data platforms and architectures