Towards Automated Evaluation of Multi-Turn Agentic AI Systems

Research unit

INNOSUISSE

Project number

129.524 INNO-ICT

Project title

Towards Automated Evaluation of Multi-Turn Agentic AI Systems

Texts for this project

	German	French	Italian	English
Key words	-	-	-
Abstract	-	-	-

Category	Text
Key words (English)	ICT, Artificial/local/extended/networked intelligence
Abstract (English)	We propose an LLM-based framework for automated evaluation of multi-turn Agentic AI systems. By simulating diverse user interactions and assessing sub-task performance, it allows for an innovative approach for systematic testing, which reduces the reliance on expensive manual annotation.