Data Engineer – Compliance Risk Analytics & Monitoring

Nasze wymagania: Proven experience building and operating ETL pipelines in production or near-production environments. Hands-on expertise with Databricks or similar Spark-based platforms, including Spark (PySpark/Scala). Proficiency in Python for maintainable and tested data processing code. Strong SQL skills for data modeling, transformation, and performance tuning. Practical experience with Microsoft Azure data services (e.g., Azure Data Factory, Azure Databricks, Azure Data Lake Storage, Azure Synapse Analytics). Familiarity with data storage formats and patterns such as Parquet, Delta Lake, JSON, and partitioning strategies. Experience with orchestration and workflow tools (e.g., Azure Data Factory, Airflow, Databricks Jobs). Awareness of data quality practices, metadata management, and lineage concepts. Understanding of security and compliance requirements for sensitive data, and experience applying access controls. Experience working within SLA-driven environments, troubleshooting operational issues. Experience supporting BI/dashboarding consumers and familiarity with BI/reporting patterns. Strong communication skills, with the ability to interact effectively with technical and non-technical stakeholders. Experience collaborating with offshore teams and vendors. Mile widziane: Practical exposure to AI/ML pipelines, MLOps, or integrating models into data platforms. Experience with GenAI applications, LLMs, or responsible AI practices. Knowledge of data governance tools (Collibra, Alation, Microsoft Purview) and specific governance practices. Certifications in Azure, Databricks, or data engineering-related fields. Experience with Agile delivery methods, Six Sigma/Lean practices, or ITIL-based service management. O projekcie: As a Data Engineer in the Compliance Risk Analytics & Monitoring team, you will play a pivotal role in designing, building, and operating scalable, secure, and reliable data platforms and pipelines. Your work will directly support critical functions such as Legal & Compliance, Audit & Assurance, and Legal Investigations, ensuring data-driven insights and operational excellence across the organization. This role is integral to advancing HCLTech’s commitment to risk management, data governance, and continuous improvement in a dynamic cloud-based environment. Zakres obowiązków: Design, develop, and maintain scalable, secure, and reliable data pipelines and platforms supporting Legal & Compliance, CRAM, Audit & Assurance, Critical & Sensitive Information, and Legal Investigations teams. Collaborate closely with data consumers, analytics engineers, data scientists, and application teams to deliver robust ETL processes, data models, and operational instrumentation across cloud environments. Apply software engineering best practices to ensure data quality, governance, lineage, and compliance standards are met. Drive continuous improvement initiatives focused on reducing cost of ownership and accelerating time-to-insight. Enhance user experience, optimize application risk management, and support ongoing improvements to business processes. Operate and troubleshoot data pipelines within SLA-driven environments, following established runbooks and resolving operational issues. Support BI/dashboarding consumers and implement common BI/reporting patterns. Implement security and compliance requirements for sensitive data, applying access controls and secure handling procedures. Collaborate effectively with offshore teams and vendors to deliver high-quality data solutions. Skill Requirements: Oferujemy: Comprehensive training programs in cloud technologies, data engineering, and compliance standards. Certification support for industry-leading platforms such as Azure and Databricks. Opportunities to participate in innovative projects and cross-functional teams, expanding your technical and business acumen. Clear advancement tracks to senior engineering, technical leadership, or specialist roles within compliance, analytics, and cloud domains. Mentorship initiatives and global mobility options, fostering continued learning and exposure to diverse challenges. A culture that values innovation, encourages creative solutions, and rewards high performance and dedication.