Senior AI Engineer with .NET

Nasze wymagania:
6+ years of hands-on engineering experience, with at least 3 years focused on production AI and LLM applications.
Strong .NET and C# background. Main day-to-day language for building AI services, RAG pipelines, agents, and evaluation tooling.
Strong, demonstrable experience integrating with LLM APIs and SDKs in production.
Hands-on experience with prompt engineering, RAG architectures, and LLM orchestration.
Strong, demonstrable experience designing and operating LLM evaluation frameworks in production. Accuracy metrics, hallucination detection, regression testing, ground truth dataset design, and output monitoring.
Hands-on experience with Azure AI Foundry or comparable evaluation and monitoring platforms.
Solid software engineering fundamentals. API design, testing, version control, CI/CD.
Strong communication. Able to engage with clinicians and non-technical stakeholders on what model evaluation means in practice.
Fluent English (working language of the team).

Mile widziane:
Hands-on experience with Semantic Kernel or comparable agentic frameworks for building multi-step reasoning, tool use, and conversational agents in production.

O projekcie:
We are looking for a Senior AI Engineer to own the evaluation and quality layer of a new AI-driven module in a European health-tech product serving more than 2.5 million users across Europe. The evaluation framework is built from scratch on top of a healthcare-specific LLM platform, covering accuracy metrics, hallucination detection, regression testing, ground truth datasets, and production monitoring. This is a fully hands-on role. Production code every day, shared core implementation on RAG pipelines, orchestration, and prompt engineering.

Zakres obowiązków:
Building RAG pipelines using Azure AI Search and Semantic Kernel, contributing to core implementation alongside the Tech Lead.
Owning the evaluation framework for model outputs across the full system — accuracy metrics, hallucination detection, clinical safety checks, regression testing across versions — using Azure AI Foundry evals and custom C# tooling.
Designing and maintaining ground truth datasets for evaluation, in collaboration with clinicians and content partners.
Building production monitoring for model outputs using Azure Monitor and Application Insights — drift detection, quality regressions, anomaly alerts.
Integrating with the Corti C# SDK for real-time output capture and evaluation pipelines.
Defining clean API contracts within the .NET and Angular platform on Azure.
Pairing with the architecture-focused Senior AI Engineer on day-to-day implementation, and sharing knowledge with the in-house engineering team.

Oferujemy:
Opportunity to shape the AI architecture of a Medical Device Class IIa module used by millions of European users.
Work alongside a strong in‑house engineering team and a dedicated second Senior AI Engineer focused on quality and evaluation.
Significant technical ownership and influence over integration, orchestration and certification activities (MDR, AI Act alignment).
Hands‑on exposure to state‑of‑the‑art LLM platforms, agent frameworks and Azure‑based production environments.
Professional responsibility that combines implementation, architecture leadership and cross‑functional collaboration.
Remote work
Unique TEAL culture, relationship- and respect-driven community, non-corporate atmosphere.
Agile approach and no bureaucracy.
Outstanding integration trips to various places in Europe for all employees.
Activities to support your well-being and health.
Luxmed Gold Extended medical care and Multisport Plus benefit.