JustJoin.IT Praca zdalna Senior New

Data Engineer (AWS) - REMOTE

emagine Polska

⚲ Lisbon

Wymagania

  • Change Management
  • DataStage (ETL)
  • SQL
  • Python
  • Scala
  • Data modeling
  • Cloud
  • Security
  • ETL
  • CI/CD

Opis stanowiska

Introduction & Summary We are seeking a highly skilled Data Engineer with expertise in AWS and a minimum of 5 years of experience in Cloud environments. This role involves designing, developing, testing, and deploying data pipelines and platforms utilizing various AWS services. An in-depth understanding of various tools and their appropriate applications, along with strong analytical and problem-solving skills, is essential for success in this position. Main Responsibilities The Data Engineer will manage a variety of tasks to ensure the successful delivery of data solutions. Responsibilities include: • Design, develop, test, and deploy data pipelines and data platforms using AWS services. • Implement and maintain data lake, lake house, or data mesh architectures. • Collaborate with data engineers, analysts, and DevOps teams to deliver business solutions. • Ensure compliance with data governance, security, and records management policies. • Troubleshoot and resolve data-related issues, supporting change management processes. • Demonstrate ownership of projects from inception to delivery. Key Requirements • Minimum of 5+ years working experience in Cloud. • Expertise in Spark/Scala. • Strong proficiency in Python and SQL. • AWS expertise in S3, Glue, Athena, EMR, EC2, and Lambda. • Experience in ETL design and data modeling. • Ability to learn and develop end-to-end knowledge of processes. • Analytical thinking to anticipate edge cases and scalable issues. • Strong problem-solving skills and attention to detail. • Intermediate level of Spanish Nice to Have • Familiarity with CI/CD tools (e.g., GitHub Actions). • Experience with Apache Iceberg or similar table formats. • Exposure to data quality frameworks (e.g., Great Expectations, Deequ). • Knowledge of Bash and HCL is a plus. Other Details This position may involve remote work and offers a dynamic, fast-paced environment focused on innovative data solutions.