Skip to content

SalesforceAIResearch/answer-engine-eval

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

13 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Answer Engine (RAG) Evaluation

Answer Engines powered by Generative AI are reshaping how people access and interact with global knowledge and online information. This repository provides the code and data necessary to reproduce our experimental results in this area, advancing research on the evaluation of Answer Engines and their underlying RAG (Retrieval-Augmented Generation) systems.

Citation

Search Engines in an AI Era: The False Promise of Factual and Verifiable Source-Cited Responses

TBA

Do RAG Systems Cover What Matters? Evaluating and Optimizing Responses with Sub-Question Coverage

@article{xie2024rag,
  title={Do RAG Systems Cover What Matters? Evaluating and Optimizing Responses with Sub-Question Coverage},
  author={Xie, Kaige and Laban, Philippe and Choubey, Prafulla Kumar and Xiong, Caiming and Wu, Chien-Sheng},
  journal={arXiv preprint arXiv:2410.15531},
  year={2024}
}

About

No description, website, or topics provided.

Resources

License

Code of conduct

Security policy

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published