diff --git a/slides/dataset.tex b/slides/dataset.tex index 38838102e44afdcc38327cea579702b982daf5f5..b21e71f1a0745e29d457eab94e03f03ba9203536 100644 --- a/slides/dataset.tex +++ b/slides/dataset.tex @@ -9,16 +9,11 @@ Relevance} \item In this dataset Wachsmuth et al. constructed a ground-truth argument graph as well as benchmark for argument ranking from this argument graph - \end{itemize} -\end{frame} - -\begin{frame} - \frametitle{Corpus} - \begin{itemize} \item The data are originally collected from the Argument Web and stored in an argument graph \item The Argument Web was the largest existing argument database with a structured argument corpora at that time + \end{itemize} \end{frame} @@ -49,13 +44,13 @@ \item To create the benchmark dataset, Wachsmuth et al. only kept arguments from the graph that fulfill their requirements \begin{itemize} - \item If a conclusion was part in more than one argument, it was kept + \item A conclusion must be part in more than one argument \item Furhtermore, Wachsmuth et al. removed all nodes that do not contain a real claim \item Additionally, an argument: \begin{itemize} \item has to be a valid-counter argument - \item must be based on reasonalb premises + \item must be based on reasonable premises \item must allow a logic interference to be drawn \end{itemize} \end{itemize} @@ -79,15 +74,15 @@ \begin{frame} \frametitle{Evaluation Method} \begin{itemize} -\item To evaluate the agreement between the experts and to ensure comparability -were than used Kendall's $\tau$ -\item Kendall $\tau$ is correlation coefficient that indicates the agreement -between two quantities with respect to a property -\begin{itemize} -\item In this case, this means the agreement between two experts with respect to -an argument -\item -1 signifies a complete disagreement and +1 a complete agreement -\end{itemize} -\item The mean over all experts for the evaluation of the benchmark is 0.36 +\item Wachsmuth et al. used Kendall's $\tau$ to evaluate the agreement between +the experts and to ensure comparability + \item Kendall $\tau$ is a correlation coefficient that indicates the agreement + between two quantities with respect to a property + \begin{itemize} + \item In this case, this means the agreement between two experts with respect to + an argument + \item -1 signifies a complete disagreement and +1 a complete agreement + \end{itemize} + \item The mean over all experts for the evaluation of the benchmark is 0.36 \end{itemize} \end{frame} \ No newline at end of file