Lead Data Engineer

Why Join Us At Cloudfide, we build and scale solutions where data becomes a strategic asset and a catalyst for innovation. We engineer large-scale Big Data and cloud-native platforms for international clients, including leading companies in retail and the Fortune 500. We work entirely in the cloud ecosystem, process massive real-time datasets, and leverage the latest technologies, including Databricks, Spark, AI/ML, and modern MLOps frameworks. Our projects drive meaningful impact - improving global digital products and powering high-visibility business decisions.As we continue to grow, you’ll have the opportunity to shape architectures, influence technical direction, mentor engineers, and lead complex initiatives. Opportunity Overview As a Lead Data Engineer, you’ll take ownership of designing and scaling end‑to‑end cloud data platforms.You’ll work with clients, architects, engineers, and cross-functional partners to define robust technical solutions and ensure excellence across delivery. Expect modern cloud environments (Azure-first), full Databricks ecosystem, strong CI/CD, and impactful projects used across global organizations.   Your Responsibilities • Designing and owning cloud-native data architectures (lakehouse, distributed processing, data platforms). • Leading technical decision-making: setting standards, defining patterns, reviewing solutions, and guiding long-term architecture. • Building and optimizing scalable, production-ready data pipelines and large-scale processing systems. • Working closely with clients and senior stakeholders to understand business needs and translate them into technical direction. • Driving engineering excellence: quality frameworks, observability, lineage, testing, documentation, performance. • Identifying architectural gaps and leading modernization & optimization initiatives. • Setting direction for technical roadmaps and ensuring platform scalability, reliability, and maintainability. • Providing technical leadership to engineers: mentoring, reviewing code, guiding design decisions (formal leadership experience not required). • Supporting integrations with BI, ML, and platform engineering teams. • Bringing in new technologies, methodologies, and innovations to elevate technical capabilities.   What We’re Looking For • 4+ years of hands-on experience as a Data Engineer, working on complex or large-scale cloud data environments. • Proven technical leadership experience - formal or informal - such as guiding other engineers, owning components, leading delivery, or driving architecture. • Strong experience with cloud platforms - we use Azure, but AWS/GCP experience is equally valuable. • Advanced Python skills - writing clean, maintainable, production-ready code for distributed systems. • Strong SQL knowledge and experience with analytical + transactional databases. • Deep understanding of DWH modeling, ETL/ELT, and modern data architectures (Lakehouse, Medallion, streaming). • Solid understanding of cloud architecture, networking fundamentals, security, scalability, and cost optimization. • Experience with large-scale or high-throughput data processing. • Strong communication skills and ability to work closely with business and technical stakeholders. • Proactive mindset, problem‑solving attitude, and willingness to drive innovation. ⭐ Nice to Have • Hands-on experience with Databricks, Spark, PySpark. • Experience with Airflow or similar orchestration tools. • Experience with Azure DevOps or GitHub Actions (CI/CD). • Exposure to AI/ML pipelines, feature stores, or MLOps tooling. • Experience leading technical delivery across distributed teams.   Why You’ll Love Cloudfide • Benefits: MyBenefit / Multisport • Enel‑Med private medical care • Professional Growth: 2,000 PLN development budget per year • Access to premium e-learning platforms • Clear opportunities to take ownership, lead strategic work, and grow into broader leadership roles • Internal promotion culture - many Cloudfide leaders grew from engineering roles • Work Environment: • Long-term partnership via UZ or B2B Remote-first, with the possibility to work from anywhere (full workation) • Flexible hours and strong support for work-life balance • Work with top-tier engineers and domain experts • Flat structure - you directly shape the company’s engineering direction • Culture & Integration: • Whole-company integration trips (including international ones) • Integration budgets for project teams • Open, supportive, and collaborative culture   Equal opportunities CLOUDFIDE is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.