Success Rate: 41.0 %
(Precision, Recall, F1) : (0.685, 0.565, 0.591)
Average Dialog Turn (Succ): 11.624
Average Dialog Turn (All): 29.224
![]() | ![]() |
Total Num | Succ Rate | Precision | Recall | F1 | Dialog Loop Failed Rate | Dialog Turn (Succ) | Dialog Turn (All) | |
---|---|---|---|---|---|---|---|---|
hotel | 351 | 0.328 | 0.307 | 0.262 | 0.273 | 0.655 | 10.835 | 27.875 |
restaurant | 355 | 0.780 | 0.633 | 0.694 | 0.653 | 0.214 | 4.931 | 12.039 |
attraction | 280 | 0.529 | 0.742 | 0.670 | 0.693 | 0.471 | 6.297 | 21.229 |
taxi | 58 | 1.000 | 1.000 | 1.000 | 1.000 | 0.000 | 4.552 | 4.552 |
train | 314 | 0.583 | 0.755 | 0.644 | 0.682 | 0.404 | 5.956 | 18.510 |
police | 23 | 0.174 | 0.739 | 0.457 | 0.551 | 0.826 | 4.000 | 33.739 |
hospital | 30 | 1.000 | 1.000 | 1.000 | 1.000 | 0.000 | 4.000 | 4.000 |
Success Rate: 32.8 %
(Precision, Recall, F1) : (0.307, 0.262, 0.273)
Average Dialog Turn (Succ): 10.835
Average Dialog Turn (All): 27.875
System NLU Failed Dialog Act:Success Rate: 78.0 %
(Precision, Recall, F1) : (0.633, 0.694, 0.653)
Average Dialog Turn (Succ): 4.931
Average Dialog Turn (All): 12.039
System NLU Failed Dialog Act:Success Rate: 52.9 %
(Precision, Recall, F1) : (0.742, 0.670, 0.693)
Average Dialog Turn (Succ): 6.297
Average Dialog Turn (All): 21.229
System NLU Failed Dialog Act:Nothing
Request But Not Inform Dialog ActSuccess Rate: 100.0 %
(Precision, Recall, F1) : (1.000, 1.000, 1.000)
Average Dialog Turn (Succ): 4.552
Average Dialog Turn (All): 4.552
System NLU Failed Dialog Act:Nothing
Bad Inform Dialog ActNothing
Request But Not Inform Dialog ActNothing
Inform But Not Request Dialog ActNothing
Success Rate: 58.3 %
(Precision, Recall, F1) : (0.755, 0.644, 0.682)
Average Dialog Turn (Succ): 5.956
Average Dialog Turn (All): 18.510
System NLU Failed Dialog Act:Nothing
Request But Not Inform Dialog ActNothing
Success Rate: 17.4 %
(Precision, Recall, F1) : (0.739, 0.457, 0.551)
Average Dialog Turn (Succ): 4.000
Average Dialog Turn (All): 33.739
System NLU Failed Dialog Act:Nothing
Request But Not Inform Dialog ActNothing
Success Rate: 100.0 %
(Precision, Recall, F1) : (1.000, 1.000, 1.000)
Average Dialog Turn (Succ): 4.000
Average Dialog Turn (All): 4.000
System NLU Failed Dialog Act:Nothing
Bad Inform Dialog ActNothing
Request But Not Inform Dialog ActNothing
Inform But Not Request Dialog ActNothing