deal with white charater in XLDST evaluation (#145)

* update sumbt translation train result with evaluation mode set

* update extract values

* automatically download sumbt model

* dstc9 eval

* dstc9 xldst evaluation

* modify example

* add .gitignore

* remove precision, recall, f1

* release 250 test data

* revise evaluation

* fix file submission example

* update precision, recall, f1 calculation

* minor change

* fix a database typo

* use selectedResults for missing name

* add value unification

* fix white character issue #144

convlab2/dst/dstc9/utils.py

@@ -69,7 +69,7 @@ def unify_value(value, subtask):
             ret[i] = unify_value(v, subtask)
         return ret
 
-    return {
+    value = {
         'multiwoz': {
             '未提及': '',
             'none': '',
@@ -81,6 +81,8 @@ def unify_value(value, subtask):
         }
     }[subtask].get(value, value)
 
+    return ' '.join(value.strip().split())
+
 
 def eval_states(gt, pred, subtask):
     def exception(description, **kargs):
@@ -135,7 +137,6 @@ def eval_states(gt, pred, subtask):
     return {
         'status': 'ok',
         'joint accuracy': joint_acc / joint_tot,
-        # 'slot accuracy': slot_acc / slot_tot,
         'slot': {
             'accuracy': slot_acc / slot_tot,
             'precision': precision,