Medior Data Engineer
⚲ Budapest
8 901 - 17 803 PLN (PERMANENT)
Wymagania
- Python
- Scala
- SQL
- Snowflake
- BigQuery
- ADF
- Spark
- PySpark
- Docker
- Kubernetes
- Data Warehousing
- Data Lake
- Databricks
- OOP
- Terraform (nice to have)
- Pulumi (nice to have)
- MongoDB (nice to have)
- DynamoDB (nice to have)
Opis stanowiska
O projekcie:
NIX, a global supplier of software engineering and IT outsourcing services, is looking for a Medior Data Engineer in its office in Budapest (Vaci Greens, 13th district). You’ll be part of a team of professionals who are ready to find the best tailor-made IT solutions for their multinational clients in various industries and solve complex problems.
WHAT WE OFFER:
- Competitive compensation packages.
- Stable employment, based on a full-time employment contract.
- Private health insurance (Medicare Сlinic).
- AYCM sport pass, providing discounts at various sports facilities in Hungary.
- Interesting tasks and diverse opportunities for developing your skills.
- Free training courses.
- Participation in internal and external thematic events, technical conferences.
- A spacious office in the heart of Budapest (13th district).
- All necessary devices and tools for your work.
- Active corporate life.
- The friendly and supportive atmosphere within the team.
If you feel you’re ready to join the team, apply for this job now! We’re already looking forward to meeting you!
Wymagania:
- Core Languages: Python or Scala (Proficient/OOP), SQL (Advanced/Analytical).
- Compute & Storage: Databricks, Snowflake, BigQuery, Synapse, Redshift.
- Orchestration: Azure Data Factory (ADF), Airflow, Dagster.
- Transformation: dbt (Core/Cloud), Spark/PySpark (Optimization focus).
- Infrastructure: Terraform (Implementation), Docker, Kubernetes (K8s).
- 2+ years of hands-on data engineering experience (ETL/ELT).
- Strong understanding of Data Warehousing concepts (Star/Snowflake Schema) and Data Lake principles (Medallion Architecture).
- Proven experience with Databricks (managing clusters, notebooks), Azure Data Factory (pipelines, data flows), Snowflake.
- Proficiency in Python (OOP, functional programming) and strong SQL skills for complex transformations.
- Practical experience with at least one major cloud (AWS, GCP, Azure) and its data services (e.g., Kinesis/Lambda, Dataflow/BigQuery, Synapse).
- Base understanding of Infrastructure as Code (Terraform). Ability to deploy and modify infrastructure resources independently.
- Ability to communicate technical decisions directly to clients and the team.
Will be a plus:
- Experience setting up complex modules in Terraform or Pulumi.
- Hands-on experience with Delta Lake or Apache Iceberg features (Time Travel, Schema Evolution).
- Experience modeling data for NoSQL databases (MongoDB, DynamoDB).
- Associate-level cloud certifications (e.g., Azure Data Engineer Associate, Databricks Certified Data Engineer).
Codzienne zadania:
- Design and implement pipelines to ingest, clean, and transform data into Data Lakes and Data Warehouses.
- Actively monitor and optimize pipelines for performance and cost. Differentiate between a working query and an efficient one.
- Configure pipeline deployments and manage environment settings using IaC tools (Terraform) and CI/CD.
- Implement data quality checks (e.g., Great Expectations, dbt tests) and ensure data integrity.
- Communicate with stakeholders to clarify requirements and provide technical guidance/code reviews to Junior engineers.
NIX, a global supplier of software engineering and IT outsourcing services, is looking for a Medior Data Engineer in its office in Budapest (Vaci Greens, 13th district). You’ll be part of a team of professionals who are ready to find the best tailor-made IT solutions for their multinational clients in various industries and solve complex problems.
WHAT WE OFFER:
- Competitive compensation packages.
- Stable employment, based on a full-time employment contract.
- Private health insurance (Medicare Сlinic).
- AYCM sport pass, providing discounts at various sports facilities in Hungary.
- Interesting tasks and diverse opportunities for developing your skills.
- Free training courses.
- Participation in internal and external thematic events, technical conferences.
- A spacious office in the heart of Budapest (13th district).
- All necessary devices and tools for your work.
- Active corporate life.
- The friendly and supportive atmosphere within the team.
If you feel you’re ready to join the team, apply for this job now! We’re already looking forward to meeting you!
Wymagania:
- Core Languages: Python or Scala (Proficient/OOP), SQL (Advanced/Analytical).
- Compute & Storage: Databricks, Snowflake, BigQuery, Synapse, Redshift.
- Orchestration: Azure Data Factory (ADF), Airflow, Dagster.
- Transformation: dbt (Core/Cloud), Spark/PySpark (Optimization focus).
- Infrastructure: Terraform (Implementation), Docker, Kubernetes (K8s).
- 2+ years of hands-on data engineering experience (ETL/ELT).
- Strong understanding of Data Warehousing concepts (Star/Snowflake Schema) and Data Lake principles (Medallion Architecture).
- Proven experience with Databricks (managing clusters, notebooks), Azure Data Factory (pipelines, data flows), Snowflake.
- Proficiency in Python (OOP, functional programming) and strong SQL skills for complex transformations.
- Practical experience with at least one major cloud (AWS, GCP, Azure) and its data services (e.g., Kinesis/Lambda, Dataflow/BigQuery, Synapse).
- Base understanding of Infrastructure as Code (Terraform). Ability to deploy and modify infrastructure resources independently.
- Ability to communicate technical decisions directly to clients and the team.
Will be a plus:
- Experience setting up complex modules in Terraform or Pulumi.
- Hands-on experience with Delta Lake or Apache Iceberg features (Time Travel, Schema Evolution).
- Experience modeling data for NoSQL databases (MongoDB, DynamoDB).
- Associate-level cloud certifications (e.g., Azure Data Engineer Associate, Databricks Certified Data Engineer).
Codzienne zadania:
- Design and implement pipelines to ingest, clean, and transform data into Data Lakes and Data Warehouses.
- Actively monitor and optimize pipelines for performance and cost. Differentiate between a working query and an efficient one.
- Configure pipeline deployments and manage environment settings using IaC tools (Terraform) and CI/CD.
- Implement data quality checks (e.g., Great Expectations, dbt tests) and ensure data integrity.
- Communicate with stakeholders to clarify requirements and provide technical guidance/code reviews to Junior engineers.
🔍 Dekoder Ogłoszenia
🔴
solve complex problems
Może oznaczać zarówno ciekawe wyzwania techniczne, jak i problemy wynikające z niedopracowanych procesów lub słabej architektury.
🔴
diverse opportunities for developing your skills
Może oznaczać zarówno realne możliwości rozwoju, jak i po prostu szeroki zakres zadań, które mogą być powtarzalne lub niekoniecznie rozwijające.
🟡
Active corporate life
Może oznaczać integracje i imprezy firmowe, ale też potencjalnie presję na uczestnictwo w nich.
🔴
The friendly and supportive atmosphere within the team
Może oznaczać autentyczną dobrą atmosferę, ale też być próbą zamaskowania braku jasnych procesów lub trudności w komunikacji na wyższych szczeblach.
🔴
2+ years of hands-on data engineeri
Może oznaczać wymagane 2 lata doświadczenia, ale też sugerować, że firma szuka kogoś, kto szybko nauczy się reszty na miejscu, bez głębszego doświadczenia.