Data Platform Engineer

🏢 About the CompanyWe collaborate exclusively with a stable US-based client, a global leader in electronic trading platforms that has operated for over 25 years. The company serves the world’s leading asset managers, central banks, hedge funds, and other institutional investors — facilitating around 30 trillion USD in trades every month across its electronic marketplaces.   📌 About the RoleYou will be building cutting-edge data platforms that ingest, manage, and process data from all of the company’s businesses. The platform will accommodate a wide range of use cases, from simple customer-facing data APIs to large-scale machine learning models. We offer: • Hardware & setup budget (e.g., standing desk, laptop, monitors, coworking space) • Optional integration trips (New York / London / Warsaw) — 3–4 days, covered by the company Responsibilities: • Build and run data platform using such technologies as public cloud infrastructure (AWS), Kafka, databases and containers  • Develop data platform based on open source software and Cloud services • Build and run ETL pipelines to onboard data into the platform, define schema, build DAG processing pipelines and monitor data quality. • Help develop machine learning development framework and pipelines • Manage and run mission crucial production services We are looking for: • Senior level Python • Very good knowledge of AWS (or GCP), daily work in Prefect (you don't need to know it, if you know Airflow or similar, that's enough), Kafka, SQL, databases, GitLab, and k8s and Linux are on the production environment. Terraform - nice to have • English min. C1