Bulldogjob Praca zdalna Senior New

Senior Data Engineer

Veriff

⚲ Tallinn

Wymagania

  • Python
  • SQL
  • S3
  • Redshift

Opis stanowiska

About the Data Engineering Team The Data Engineering team builds and operates the analytical data platform that powers machine learning, data science, analytics, and reporting across Veriff. We are responsible for large-scale data ingestion, platform reliability, and enterprise data governance — ensuring Veriffians have access to accurate and timely data. In this role, you will own and evolve our data lake and data warehouse infrastructure, driving platform-level data management, governance, and reliability at scale. You'll help us protect honest people online by: - Owning and evolving our data lake and data warehouse infrastructure using technologies such as Spark, Apache Iceberg, S3, Trino/Athena, and Redshift. - Designing and maintaining platform-level data transformation pipelines in Python and SQL — focused on schema evolution, partitioning, compaction, and deduplication. - Implementing optimized storage formats (Parquet, Avro, ORC), partitioning strategies, and indexing to improve query performance and reduce platform costs. - Driving data governance initiatives — PII detection and classification, access control policies, data cataloging, lineage tracking, and data quality frameworks. - Ensuring the availability, reliability, and cost efficiency of the data platform, including observability, monitoring, and alerting for pipeline and query engine health. - Collaborating with ML, analytics, product, and engineering teams to define data contracts, maintain schema consistency, and provide clean, well-governed datasets. - Contributing to disaster recovery strategy and multi-region reliability of the data platform. About Veriff: We are the preferred identity verification platform partner for the world’s most innovative growth-driven organizations helping conveniently verify and safeguard users anywhere in the world. We support the broadest number of identity documents from nearly every country and territory in the world - and this is continually increasing! With a diverse team in the United States, United Kingdom, Spain, and Estonia, as well as robust backing and funding from investors including Accel, Alkeon, IVP, Tiger Capital, and Y Combinator, we’re dedicated to helping businesses and individuals build a safer and more secure world. We strive to be the benchmark for trust online, and we take pride in being a positive force.