Sally Fang
2024
Evaluation and Continual Improvement for an Enterprise AI Assistant
Akash Maharaj
|
Kun Qian
|
Uttaran Bhattacharya
|
Sally Fang
|
Horia Galatanu
|
Manas Garg
|
Rachel Hanessian
|
Nishant Kapoor
|
Ken Russell
|
Shivakumar Vaithyanathan
|
Yunyao Li
Proceedings of the Fifth Workshop on Data Science with Human-in-the-Loop (DaSH 2024)
The development of conversational AI assistants is an iterative process with many components involved. As such, the evaluation and continual improvement of these assistants is a complex and multifaceted problem. This paper introduces the challenges in evaluating and improving a generative AI assistant for enterprise that is under active development and how we address these challenges. We also share preliminary results and discuss lessons learned.
Search
Co-authors
- Akash Maharaj 1
- Kun Qian 1
- Uttaran Bhattacharya 1
- Horia Galatanu 1
- Manas Garg 1
- show all...