Success Rate: 56.6 %
(Precision, Recall, F1) : (0.648, 0.790, 0.681)
Average Dialog Turn (Succ): 12.880
Average Dialog Turn (All): 22.110
![]() | ![]() |
Total Num | Succ Rate | Precision | Recall | F1 | Dialog Loop Failed Rate | Dialog Turn (Succ) | Dialog Turn (All) | |
---|---|---|---|---|---|---|---|---|
hotel | 402 | 0.500 | 0.357 | 0.515 | 0.391 | 0.343 | 7.851 | 16.343 |
restaurant | 402 | 0.677 | 0.534 | 0.739 | 0.594 | 0.296 | 8.213 | 14.756 |
attraction | 309 | 0.883 | 0.753 | 0.920 | 0.800 | 0.100 | 6.388 | 9.502 |
taxi | 121 | 0.802 | 0.884 | 0.843 | 0.857 | 0.174 | 7.052 | 9.868 |
train | 349 | 0.857 | 0.900 | 0.919 | 0.907 | 0.129 | 7.391 | 8.395 |
police | 23 | 1.000 | 0.935 | 1.000 | 0.957 | 0.000 | 2.000 | 2.000 |
hospital | 30 | 0.933 | 0.933 | 0.933 | 0.933 | 0.067 | 2.000 | 4.533 |
Success Rate: 50.0 %
(Precision, Recall, F1) : (0.357, 0.515, 0.391)
Average Dialog Turn (Succ): 7.851
Average Dialog Turn (All): 16.343
System NLU Failed Dialog Act:Success Rate: 67.7 %
(Precision, Recall, F1) : (0.534, 0.739, 0.594)
Average Dialog Turn (Succ): 8.213
Average Dialog Turn (All): 14.756
System NLU Failed Dialog Act:Success Rate: 88.3 %
(Precision, Recall, F1) : (0.753, 0.920, 0.800)
Average Dialog Turn (Succ): 6.388
Average Dialog Turn (All): 9.502
System NLU Failed Dialog Act:Success Rate: 80.2 %
(Precision, Recall, F1) : (0.884, 0.843, 0.857)
Average Dialog Turn (Succ): 7.052
Average Dialog Turn (All): 9.868
System NLU Failed Dialog Act:Nothing
Request But Not Inform Dialog ActNothing
Success Rate: 85.7 %
(Precision, Recall, F1) : (0.900, 0.919, 0.907)
Average Dialog Turn (Succ): 7.391
Average Dialog Turn (All): 8.395
System NLU Failed Dialog Act:Nothing
Success Rate: 100.0 %
(Precision, Recall, F1) : (0.935, 1.000, 0.957)
Average Dialog Turn (Succ): 2.000
Average Dialog Turn (All): 2.000
System NLU Failed Dialog Act:Nothing
Bad Inform Dialog ActNothing
Request But Not Inform Dialog ActNothing
Inform But Not Request Dialog ActSuccess Rate: 93.3 %
(Precision, Recall, F1) : (0.933, 0.933, 0.933)
Average Dialog Turn (Succ): 2.000
Average Dialog Turn (All): 4.533
System NLU Failed Dialog Act:Nothing
Request But Not Inform Dialog ActNothing