Entity F1 without KB

[avinashsai]

Hi,
Congratulations for the amazing paper.

I have a doubt on how to measure Entity F1 Score without KB input. I have a prediction file (system responses) and ground truth file. How should I measure Entity F1 as a whole?

[andreamad8]

Hi,

the KB to compute Entity F1 Score is used to generate the FP entities, together with the whole list extracted from the ontology.

So, in general, you need 1) a list of entity appearing in the response, and 2) a global set of entities, from the KB usually.

I hope this helps, let me know if you have more questions.

Andrea