From 2cfe5c08fd0c3be340794d7658c2a052cd7a350a Mon Sep 17 00:00:00 2001 From: Christian Geishauser <45534723+ChrisGeishauser@users.noreply.github.com> Date: Mon, 23 May 2022 16:45:47 +0200 Subject: [PATCH] Update README.md --- convlab2/policy/README.md | 18 ++++++++++++++++++ 1 file changed, 18 insertions(+) diff --git a/convlab2/policy/README.md b/convlab2/policy/README.md index cc0b29ed..1990cdd6 100755 --- a/convlab2/policy/README.md +++ b/convlab2/policy/README.md @@ -16,3 +16,21 @@ The interfaces for dialog policy are defined in policy.Policy: and outputs the next system action. - **init_session** reset the model variables for a new dialog session. + +## Rule based simulator results + +| Model | Complete rate | Success rate | Average return | Turns | Average actions | +|-------|---------------|--------------|----------------|-------|-----------------| +| MLE | | | | | | +| PG | | | | | | +| GDPL | | | | | | +| PPO | | | | | | + +## Transformer based user simulator (TUS) results + +| Model | Complete rate | Success rate | Average return | Turns | Average actions | +|-------|---------------|--------------|----------------|-------|-----------------| +| MLE | | | | | | +| PG | | | | | | +| GDPL | | | | | | +| PPO | | | | | | -- GitLab