Data Engineer
Link Group
⚲ Warszawa
20 000 - 25 000 PLN (B2B)
Wymagania
- Python
- SQL
- Data pipelines
- Data warehouse
- Relational database
- Data modeling
- Apache Spark
- AWS
- Azure
- GCP
- Airflow
- dbt
- CI/CD
- Java (nice to have)
- Scala (nice to have)
- Kafka (nice to have)
- Cloud cost optimization (nice to have)
Opis stanowiska
O projekcie: We are looking for a Data Engineer to join our team and help build reliable and scalable data solutions. In this role, you will design data flows, manage large datasets, and support analytics and reporting needs. You will work closely with engineers, analysts, and business stakeholders to deliver high-quality data products. Wymagania: - Strong Python and advanced SQL skills - Experience with data pipelines and data warehouses - Knowledge of relational databases and data modeling - Experience with Apache Spark or similar distributed processing tools - Hands-on experience with cloud platforms (AWS, Azure, or GCP) - Experience with orchestration tools (e.g., Airflow) and dbt - Understanding of CI/CD, data quality, and data governance concepts Nice to Have - Experience with Java, Scala, or scripting languages - Knowledge of streaming tools (e.g., Kafka) - Experience with cloud cost optimization Codzienne zadania: - Develop and maintain data pipelines for batch and near real-time processing - Design and implement scalable data warehouse solutions - Build efficient data models focused on performance and usability - Ensure stability of data workflows, including scheduling and error handling - Integrate data from APIs, SaaS platforms, and internal systems - Support analytics teams and BI tools such as Power BI, Tableau, or Looker - Collaborate with cross-functional teams to deliver data solutions - Monitor data quality and optimize performance of data processes